Machine Learning Research
DeepSeek Sharpens Its Reasoning: DeepSeek-R1, an affordable rival to OpenAI’s o1
A new open model rivals OpenAI’s o1, and it’s free to use or modify.
Large Language Models (LLMs)
Machine Learning Research
DeepSeek Ups the Open Weights Ante: DeepSeek-V3 redefines LLM performance and cost efficiency
A new model from Hangzhou upstart DeepSeek delivers outstanding performance and may change the equation for training costs.
Machine Learning Research
Better Performance From Merged Models: Localize-and-Stitch improves methods for merging and fine-tuning multiple models
Merging multiple fine-tuned models is a less expensive alternative to hosting multiple specialized models. But, while model merging can deliver higher average performance across several tasks, it often results in lower performance on specific tasks. New work addresses this issue.
Machine Learning Research
Massively More Training Text: Harvard unveils a million-book corpus for AI training
Harvard University amassed a huge new text corpus for training machine learning models.
Machine Learning Research
Models Can Use Tools in Deceptive Ways: Researchers expose AI models' deceptive behaviors
Large language models have been shown to be capable of lying when users unintentionally give them an incentive to do so. Further research shows that LLMs with access to tools can be incentivized to use them in deceptive ways.
Machine Learning Research
What LLM Users Want: Anthropic reveals how users interact with Claude 3.5
Anthropic analyzed 1 million anonymized conversations between users and Claude 3.5 Sonnet. The study found that most people used the model for software development and also revealed malfunctions and jailbreaks.
Machine Learning Research
Joseph Gonzalez: General intelligence
In 2025, I expect progress in training foundation models to slow down as we hit scaling limits and inference costs continue to rise.
Machine Learning Research
Smaller Is Beautiful: Compact AI models redefine efficiency, bringing advanced capabilities to everyday devices
For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.
Business
Prices Tumble: AI price wars drive costs down as competition heats up
Fierce competition among model makers and cloud providers drove down the price of access to state-of-the-art models.
Machine Learning Research
When LLMs Propose Research Ideas: Stanford study finds AI matches human experts at writing research proposals
How do agents based on large language models compare to human experts when it comes to proposing machine learning research? Pretty well, according to one study.
Machine Learning Research
Multimodal Modeling on the Double: Google introduces Gemini 2.0 Flash, a faster, more capable AI model
Google’s Gemini 2.0 Flash, the first member of its updated Gemini family of large multimodal models, combines speed with performance that exceeds that of its earlier flagship model, Gemini 1.5 Pro, on several measures.
Machine Learning Research
Phi-4 Beats Models Five Times Its Size: Microsoft’s Phi-4 learned from a blend of synthetic and organic data to surpass larger models in math and reasoning benchmarks
Microsoft updated its smallest model family with a single, surprisingly high-performance model.