Machine Learning Research
AI Generates Viral Genomes: Researchers use genomic language models to create custom viruses
Researchers used AI models to create novel viruses from scratch.
Machine Learning Research
Machine Learning Research
Faster Reinforcement Learning: New technique auto-selects training examples to speed up fine-tuning
Fine-tuning large language models via reinforcement learning is computationally expensive, but researchers found a way to streamline the process.
Machine Learning Research
What ChatGPT Users Want: ChatGPT users now more likely to be young, female, and seeking info, study shows
What do ChatGPT’s 700 million weekly active users do with it? OpenAI teamed up with a Harvard economist to find out.
Business
Agents of Commerce: Google’s AP2 gives developers new tools to build agentic payments
Google launched an open protocol for agentic payments that enables agents based on any large language model to purchase items over the internet.
Machine Learning Research
Transformers Energized: Energy-Based Transformers (EBTs) use gradient descent to gradually predict the next token
A new type of transformer can check its work. Instead of guessing the next output token in one shot like a typical transformer, it starts with a rough version of the token and improves it step by step.
Machine Learning Research
Qwen3-Next Accelerates: Alibaba’s new model uses hybrid attention layers and a sparse MoE architecture for speed and performance
Alibaba updated its popular Qwen3 open-weights models with a number of fresh, speed-boosting tweaks.
Machine Learning Research
10 Million Tokens of Input Context: ATLAS, a transformer-like architecture, can process a context window as large as ten million tokens
An alternative to attention enables large language models to track relationships among words across extraordinarily wide spans of text.
Machine Learning Research
Cybersecurity for Agents: Meta releases LlamaFirewall, an open-source defense against AI hijacking
Autonomous agents built on large language models introduce distinct security concerns. Researchers designed a system to protect agents from common vulnerabilities.
Machine Learning Research
Better Image Processing Through Self-Supervised Learning: Meta’s DINOv3 gets an updated loss term and improved vision performance
DINOv2 showed that a vision transformer pretrained on unlabeled images could produce embeddings that are useful for a wide variety of tasks. Now it has been updated to improve the performance of its embeddings in segmentation and other vision tasks.
Machine Learning Research
Does Your Model Generalize or Memorize: Researchers find models with more parameters copy more bits from training sets
Benchmarks can measure how well large language models apply what they’ve learned from their training data to new data, but it’s harder to measure the degree to which they simply memorized their training data. New work proposes a way to gauge memorization.
Machine Learning Research
Mixture of Video Experts: Alibaba’s Wan 2.2 video models adopt a new architecture to sort noisy from less-noisy inputs
The mixture-of-experts approach that has boosted the performance of large language models may do the same for video generation.
Machine Learning Research
Training Data for Coding Assistants: Stanford and Alibaba build bug fixing dataset and pipeline to train AI
A bottleneck in fine-tuning large language models for software engineering is building a dataset that can show them how to edit code, search for subroutines, write test scripts, control a terminal, manage a file system, and so on. Researchers built a pipeline that produces such data automatically.