Machine Learning Research
Compact Reasoning: QwQ-32B challenges DeepSeek-R1 and other larger reasoning models
Most models that have learned to reason via reinforcement learning were huge models. A much smaller model now competes with them.
Large Language Models (LLMs)
Machine Learning Research
Budget for Reasoning to the Token: Claude 3.7 Sonnet adds extended thinking mode
Anthropic’s Claude 3.7 Sonnet implements a hybrid reasoning approach that lets users decide how much thinking they want the model to do before it renders a response.
Machine Learning Research
OpenAI’s GPT-4.5 Goes Big: OpenAI releases GPT-4.5, its most powerful non-reasoning model and maybe its last
OpenAI launched GPT-4.5, which may be its last non-reasoning model.
Machine Learning Research
Text Generation by Diffusion: Mercury Coder uses diffusion to generate text
Typical large language models are autoregressive, predicting the next token, one at a time, from left to right. A new model hones all text tokens at once.
Machine Learning Research
Reasoning in Vectors, Not Text: Meta introduces Chain of Continuous Thought (Coconut) to improve next-token prediction
Although large language models can improve their performance by generating a chain of thought (CoT) — intermediate text tokens that break down the process of responding to a prompt into a series of steps.
Business
Musk Complicates OpenAI’s Plan: Elon Musk’s $97.4B bid for OpenAI rejected, fueling AI power struggle
Elon Musk and a group of investors made an unsolicited bid to buy the assets of the nonprofit that controls OpenAI, complicating the AI powerhouse’s future plans.
Machine Learning Research
Mobile Apps to Order: Replit’s agent-powered mobile app expands to full app development
Replit, an AI-driven integrated development environment, updated its mobile app to generate further mobile apps to order.
Machine Learning Research
Grok 3 Scales Up: Grok 3, xAI’s new model family, improves on its predecessors, adds reasoning
xAI’s new model family suggests that devoting more computation to training remains a viable path to building more capable AI.
Machine Learning Research
Alibaba’s Answer to DeepSeek: Alibaba debuts Qwen2.5-VL, a powerful family of open vision-language models
While Hangzhou’s DeepSeek flexed its muscles, Chinese tech giant Alibaba vied for the spotlight with new open vision-language models.
Machine Learning Research
Agents Go Deep: OpenAI’s Deep Research agent generates detailed reports by analyzing web sources
OpenAI introduced a state-of-the-art agent that produces research reports by scouring the web and reasoning over what it finds.
Machine Learning Research
Gemini Thinks Faster: Google’s Gemini 2.0 Flash Thinking advances in reasoning, outperforms DeepSeek-R1
Google updated the December-vintage reasoning model Gemini 2.0 Flash Thinking and other Flash models, gaining ground on OpenAI o1 and DeepSeek-R1.
Machine Learning Research
Training for Computer Use: UI-TARS shows strong computer use capabilities in benchmarks
As Anthropic, Google, OpenAI, and others roll out agents that are capable of computer use, new work shows how underlying models can be trained to do this.