Data Points
Qwen-2VL shines on vision tasks: Cerebras processes up to 1,800 tokens per second
Qwen2-VL is available as 2 billion and 7 billion parameter versions under an Apache 2.0 license, as well as a 72 billion parameter API version.
Analytics DeepLearning.AI
Machine Learning Research
Multimodal to the Max: 4M-21 multimodal model excels in handling diverse input and output types
Researchers introduced a model that handles an unprecedented number of input and output types, including many related to performing computer vision tasks.
Tech & Society
AI Lobby Expands: AI lobbying surges as U.S. companies ramp up efforts to influence policy
AI is a red-hot topic for lobbyists who aim to influence government policies in the United States.
Generative AI
Agentic Coding Strides Forward: Genie coding assistant outperforms competitors on SWE-bench by over 30 percent
An agentic coding assistant boosted the state of the art in an important benchmark by more than 30 percent.
Science
A Lost Voice Regained: Brain implants paired with neural network reconstruct speech for ALS patient
A man who lost the ability to speak four years ago is sounding like his earlier self, thanks to a collection of brain implants and machine learning models.
Letters
Falling LLM Token Prices and What They Mean for AI Companies: The price of using large language models like GPT-4 is falling dramatically. Here’s how AI companies can capitalize on the trend.
After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).
The Batch Newsletter
AI Restores ALS Patient’s Voice, AI Lobby Grows, Agentic Coding Advances, Massively Multimodal Model
The Batch AI News and Insights: After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).
Data Points
Nvidia makes new mini versions of open models: Plus, Apple trains low-power “always-on” AI models
NVIDIA and Mistral AI introduced Mistral-NeMo-Minitron 8B, a new language model that outperforms similarly sized models on multiple benchmarks.
Data Points
Jamba 1.5 models mix transformers with Mamba: Plus, Ideogram’s new image model with a new API
The two new Jamba models use a hybrid solid state model-transformer architecture, feature an effective 256,000-token context window, and outperform competitors in their size
The Batch Newsletter
AI Agents Generate Novel Research, Google Imagen 3 Raises the Bar, Alibaba’s Open Models for Specialized Tasks, Scaling Laws for Data Quality
The Batch AI News and Insights: I’m encouraged at the progress of the U.S. government at moving to stem harmful AI applications.
Machine Learning Research
Scaling Laws for Data Quality: Scaling laws reveal the impact of data quality in vision-language model training
When training vision-language models, developers often remove lower-quality examples from the training set. But keeping only the highest-quality examples may not be ideal, researchers found.
Generative AI
Open Models for Math and Audio: Alibaba advances open-weight LLMs with Qwen2 Math and Audio variants
Alibaba followed up its open-weights Qwen2 large language models with specialized variations.