Machine Learning Research
Better Video, Fewer Tokens: STORM Processes Fewer Tokens And Still Beats GPT-4o On Video Understanding Benchmarks
Researchers reduced the number of tokens needed to represent video frames to be fed to a transformer.
Large Language Models (LLMs)
Business
AI Market Trends in Charts and Graphs: Venture Capitalist Mary Meeker Revives Her Trend Reports With a Deep Dive Into the AI Boom
Renowned investment analyst Mary Meeker is back with a report on the AI market, six years after publishing her last survey of the internet.
Machine Learning Research
Next-Level DeepSeek-R1: DeepSeek-R1’s update leads all open models and brings it up to date with the latest from Google and OpenAI
DeepSeek updated its groundbreaking DeepSeek-R1 large language model to strike another blow for open-weights performance.
Machine Learning Research
How DeepSeek Did It: Researchers describe training methods and hardware choices for DeepSeek’s V3 and R1 models
DeepSeek made headlines late last year, when it built a state-of-the-art, open-weights large language model at a cost far lower than usual. The upstart developer shared new details about its method.
Machine Learning Research
Claude 4 Advances Code Generation: Anthropic debuts new Claude 4 Sonnet and Claude 4 Opus models, featuring top benchmarks in coding
Anthropic continued its tradition of building AI models that raise the bar in coding tasks.
Machine Learning Research
4-Bit Efficiency, 16-Bit Accuracy: Microsoft researchers show that heavily quantized versions of Llama can perform as well as near-full-precision
Using an 8-bit number format like FP8 during training saves computation compared to 16- or 32-bit formats, but it can yield less-accurate results. Researchers trained models using 4-bit numbers without sacrificing accuracy.
Machine Learning Research
Your Robot Dev Team: OpenAI introduces Codex, a multi-agent cloud-based software engineering tool in ChatGPT
OpenAI launched an agentic software-development system.
Machine Learning Research
Memory Layers for More-Factual Output: Meta researchers build Llama-style models that recall details without needing more computing resources
Improving a large language model’s factual accuracy typically requires making it bigger, which in turn, involves more computation. Researchers devised an architecture that enables models to recall relevant details without significantly increasing the amount of computation required.
Machine Learning Research
Open, Compact Code Generator: DeepCoder-14B-Preview further fine-tunes reasoning models for coding
An open-source code generator performs comparably to the reasoning models DeepSeek-R1 and OpenAI o1 with a much smaller model.
Machine Learning Research
Reasoning Models With Recipes: Microsoft unveils training details for Phi-4-reasoning, Phi-4-reasoning-plus, and Phi-4-mini-reasoning
Microsoft published its latest recipe for training reasoning models, substantially expanding what is still a fairly small base of public knowledge.
Machine Learning Research
One Weird Trick for Better Reasoning: Researchers fine-tune LLM for reasoning with only 1,000 examples
Researchers showed that supervised fine-tuning on as few as 1,000 examples can enable a pretrained large language model to reason — and a clever gambit can boost its performance to rival that of top reasoning models.
Machine Learning Research
Qwen3 Takes On DeepSeek-R1: Alibaba releases the Qwen3 family of open LLMs with optional reasoning
Alibaba’s new model family may unseat DeepSeek-R1’s four-month reign as the top open-weights large language model.