Machine Learning Research
Life After Llama: With Muse Spark, Meta pivots away from its open-weights Llama strategy
Meta pivoted from its open-weights strategy to deliver a closed alternative.
Machine Learning Research
Machine Learning Research
How Liquids and Gases Behave: A dynamic fluids model appears to solve transformers’ pixellation problem
Simulating complex physical systems through traditional numerical methods is slow and expensive, and simulations based on machine learning are usually specialized for a specific type of system, such as water in a pipe or atmosphere surrounding a planet.
Science
Dark DNA Unveiled: Google’s AlphaGenome interprets DNA that regulates genetic expression
An open-weights model could help scientists compare the impact of genetic variations, identify mutations that cause diseases, and develop treatments.
Machine Learning Research
Claude Mythos Preview Raises Security Worries: Why Claude’s advanced Mythos Preview model will be limited-release-only
Anthropic took unusual steps to prepare the world for a forthcoming large language model that it said poses extraordinary risks to cybersecurity.
Machine Learning Research
Learning Long Context at Inference: Test-Time Training End-to-End (TTT-E2E) retrains model weights to handle long inputs
Large language models typically become less accurate and slower when they process longer contexts, but researchers enabled an LLM to keep accuracy stable and inference time constant as its context grew.
Machine Learning Research
Gemini’s Music Generator: Google debuted Lyria 3, an app that turns text or images into 30-second songs
Google added a music generator to Gemini and YouTube, putting a model that produces synthetic songs in front of hundreds of millions of users.
Machine Learning Research
Inside Claude Code: Claude Code’s source code leaked, exposing potential future features Kairos and autoDream
The inner workings of the popular coding agent Claude Code are available for all to see.
Machine Learning Research
Context As An External Variable: Recursive Language Models offer path to aramatically expand beyond the context window
When processing long contexts, large language models often lose track of details or devolve into nonsense. Researchers reduced these effects by managing context externally.
Machine Learning Research
xAI’s Cost-Effective Video Generator: Grok Imagine 1.0 sharply cuts costs for high-quality video generation
xAI launched a video generator that topped an independent quality ranking at a fraction of competitors’ prices.
Machine Learning Research
Open-Source Speed Demon: Nvidia’s open Nemotron 3 Super 120B-A12B model sets new paces in its class
Nvidia, the dominant supplier of AI chips, released a competitive open-source large language model whose speed tops its size class — the first open-weights leader to come from the United States since last year, when Meta delivered Llama 4.
Machine Learning Research
A Single Tokenizer for Visual Media: Apple’s AToken, a multimodal model with a single encoder and tokenizer for images, videos, and 3D objects
Multimodal models typically use different tokenizers to embed different media types, and different encoders when training to generate media rather than classify it.
Business
DeepSeek Snubs Nvidia for Huawei: DeepSeek made its upcoming 4.0 model available for performance testing to Chinese chipmakers but not U.S, ones
DeepSeek, the Chinese developer of outstanding open-weights models, has withheld an upcoming update of its flagship model from U.S. chip makers, a move that intensifies the AI rivalry between the U.S. and China.