Machine Learning Research
Long Context Gets Up to Speed: AI21 Labs’ Jamba 1.5 outpaces transformers in long-text processing
A new model generates tokens faster than current transformers, especially when processing long inputs.
Latest
Data Points
Redefining what counts as open source AI: A small hybrid model for fast on-device inference
The Open Source Initiative updated its Open Source AI Definition draft, clarifying that both AI models and weights must meet open source standards.
Data Points
Qwen-2VL shines on vision tasks: Cerebras processes up to 1,800 tokens per second
Qwen2-VL is available as 2 billion and 7 billion parameter versions under an Apache 2.0 license, as well as a 72 billion parameter API version.
Machine Learning Research
Multimodal to the Max: 4M-21 multimodal model excels in handling diverse input and output types
Researchers introduced a model that handles an unprecedented number of input and output types, including many related to performing computer vision tasks.
Tech & Society
AI Lobby Expands: AI lobbying surges as U.S. companies ramp up efforts to influence policy
AI is a red-hot topic for lobbyists who aim to influence government policies in the United States.
Generative AI
Agentic Coding Strides Forward: Genie coding assistant outperforms competitors on SWE-bench by over 30 percent
An agentic coding assistant boosted the state of the art in an important benchmark by more than 30 percent.
Science
A Lost Voice Regained: Brain implants paired with neural network reconstruct speech for ALS patient
A man who lost the ability to speak four years ago is sounding like his earlier self, thanks to a collection of brain implants and machine learning models.
Letters
Falling LLM Token Prices and What They Mean for AI Companies: The price of using large language models like GPT-4 is falling dramatically. Here’s how AI companies can capitalize on the trend.
After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).
The Batch Newsletter
AI Restores ALS Patient’s Voice, AI Lobby Grows, Agentic Coding Advances, Massively Multimodal Model
The Batch AI News and Insights: After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).
Data Points
Nvidia makes new mini versions of open models: Plus, Apple trains low-power “always-on” AI models
NVIDIA and Mistral AI introduced Mistral-NeMo-Minitron 8B, a new language model that outperforms similarly sized models on multiple benchmarks.
Data Points
Jamba 1.5 models mix transformers with Mamba: Plus, Ideogram’s new image model with a new API
The two new Jamba models use a hybrid solid state model-transformer architecture, feature an effective 256,000-token context window, and outperform competitors in their size
The Batch Newsletter
AI Agents Generate Novel Research, Google Imagen 3 Raises the Bar, Alibaba’s Open Models for Specialized Tasks, Scaling Laws for Data Quality
The Batch AI News and Insights: I’m encouraged at the progress of the U.S. government at moving to stem harmful AI applications.