Machine Learning Research
Joseph Gonzalez: General intelligence
In 2025, I expect progress in training foundation models to slow down as we hit scaling limits and inference costs continue to rise.
Large Language Models (LLMs)
Machine Learning Research
Smaller Is Beautiful: Compact AI models redefine efficiency, bringing advanced capabilities to everyday devices
For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.
Business
Prices Tumble: AI price wars drive costs down as competition heats up
Fierce competition among model makers and cloud providers drove down the price of access to state-of-the-art models.
Machine Learning Research
When LLMs Propose Research Ideas: Stanford study finds AI matches human experts at writing research proposals
How do agents based on large language models compare to human experts when it comes to proposing machine learning research? Pretty well, according to one study.
Machine Learning Research
Multimodal Modeling on the Double: Google introduces Gemini 2.0 Flash, a faster, more capable AI model
Google’s Gemini 2.0 Flash, the first member of its updated Gemini family of large multimodal models, combines speed with performance that exceeds that of its earlier flagship model, Gemini 1.5 Pro, on several measures.
Machine Learning Research
Phi-4 Beats Models Five Times Its Size: Microsoft’s Phi-4 learned from a blend of synthetic and organic data to surpass larger models in math and reasoning benchmarks
Microsoft updated its smallest model family with a single, surprisingly high-performance model.
Machine Learning Research
Getting the Facts Right: A memory method that reduces hallucinations in LLMs
Large language models that remember more hallucinate less.
Machine Learning Research
Higher Reasoning: OpenAI debuts o1 and pro mode for $200/month
OpenAI launched not only its highly anticipated o1 model but also an operating mode that enables the model to deliver higher performance — at a hefty price.
Machine Learning Research
Mistral’s Vision-Language Contender: Mistral unveils Pixtral Large, a rival to top vision-language models
Mistral AI unveiled Pixtral Large, which rivals top models at processing combinations of text and images.
Business
Agents Open the Wallet: Stripe builds ecommerce agent toolkit for AI to securely spend money
One of the world’s biggest payment processors is enabling large language models to spend real money.
Business
AI Power Couple Recommits: Amazon deepens Anthropic partnership with $4 billion investment
Amazon and Anthropic expanded their partnership, potentially strengthening Amazon Web Services’ AI infrastructure and lengthening the high-flying startup’s runway.
Machine Learning Research
Reasoning Revealed: DeepSeek-R1, a transparent challenger to OpenAI o1
An up-and-coming Hangzhou AI lab unveiled a model that implements run-time reasoning similar to OpenAI o1 and delivers competitive performance. Unlike o1, it displays its reasoning steps.