Machine Learning Research
DeepSeek Pushes the Frontier Again: DeepSeek refreshed its V4 Flash model with an impressive fine-tune
DeepSeek’s updated small model overtook the company’s own flagship.
Transformers
Machine Learning Research
Kimi K3 Reveals How A Giant Frontier AI Model Works: Moonshot's latest model outshines all but GPT-5.6 Sol and Claude 5 Fable
Moonshot’s latest model leapfrogged the month-old GLM-5.2 and a host of proprietary competitors to finish just behind GPT-5.6 Sol and Claude Fable 5 on many benchmarks.
Machine Learning Research
Biological Molecules as Language: ESMFold2 approaches AlphaFold 3 performance but with an open, Transformer-based architecture
Google’s AlphaFold models pioneered the task of finding the shapes of biologically active molecules, opening new pathways for drug development.
Machine Learning Research
Large-Model AI for Apple Devices: 2026's Apple Foundation Models bring AI to MacBooks, iPhones, and the cloud
The third generation of Apple Foundation Models — fruit of Apple’s collaboration with Google — introduces a variation on the mixture-of-experts architecture that runs on local devices.
Machine Learning Research
Built-In Conversational Interactivity: Thinking Machines reveals its first interaction model, a new type of multimodal AI
Conversational models typically wait for a turn before they respond.
Machine Learning Research
How Liquids and Gases Behave: A dynamic fluids model appears to solve transformers’ pixellation problem
Simulating complex physical systems through traditional numerical methods is slow and expensive, and simulations based on machine learning are usually specialized for a specific type of system, such as water in a pipe or atmosphere surrounding a planet.
Science
Dark DNA Unveiled: Google’s AlphaGenome interprets DNA that regulates genetic expression
An open-weights model could help scientists compare the impact of genetic variations, identify mutations that cause diseases, and develop treatments.
Machine Learning Research
Learning Long Context at Inference: Test-Time Training End-to-End (TTT-E2E) retrains model weights to handle long inputs
Large language models typically become less accurate and slower when they process longer contexts, but researchers enabled an LLM to keep accuracy stable and inference time constant as its context grew.
Machine Learning Research
A Single Tokenizer for Visual Media: Apple’s AToken, a multimodal model with a single encoder and tokenizer for images, videos, and 3D objects
Multimodal models typically use different tokenizers to embed different media types, and different encoders when training to generate media rather than classify it.
Machine Learning Research
Sleep Signals Predict Illness: SleepFM detects signs of neurological disorders years before symptoms manifest
Difficulty sleeping often precedes heart disease, psychiatric disorders, and many other illnesses. Researchers used data gathered during sleep studies to detect such conditions.
Machine Learning Research
Faster Reasoning at the Edge: Liquid AI’s small reasoning model mixes attention with convolutional layers for efficiency
Reasoning models in the 1 to 2 billion-parameter range typically require more than 1 gigabyte of RAM to run. Liquid AI released one that runs in less than 900 megabytes, and does it with exceptional speed and efficiency.
Machine Learning Research
Recipe for Smaller, Capable Models: Mistral uses cascade distillation on Mistral 3 to build Ministral family
Mistral compressed Mistral Small 3.1 into much smaller versions, yielding a family of relatively small, open-weights, vision-language models that perform better by some measures than competing models of similar size. The method combines pruning and distillation.