Machine Learning Research
Making LLMs Explainable: Google’s Gemma Scope probes how large language models think
Researchers have probed the inner workings of individual layers of large language models. A new tool applies this approach to all layers.
Latest
Tech & Society
AI-Powered Policing Goes National: Argentina launches AI unit to predict and prevent crimes
Argentina created a national law-enforcement department that will use AI to detect crimes as they’re committed, investigate them afterward, and predict them before they occur.
Machine Learning Research
Models Ranked for Hallucinations: Measuring language model hallucinations during information retrieval
How often do large language models make up information when they generate text based on a retrieved document? A study evaluated the tendency of popular models to hallucinate while performing retrieval-augmented generation (RAG).
Machine Learning Research
Long Context Gets Up to Speed: AI21 Labs’ Jamba 1.5 outpaces transformers in long-text processing
A new model generates tokens faster than current transformers, especially when processing long inputs.
Data Points
Redefining what counts as open source AI: A small hybrid model for fast on-device inference
The Open Source Initiative updated its Open Source AI Definition draft, clarifying that both AI models and weights must meet open source standards.
Data Points
Qwen-2VL shines on vision tasks: Cerebras processes up to 1,800 tokens per second
Qwen2-VL is available as 2 billion and 7 billion parameter versions under an Apache 2.0 license, as well as a 72 billion parameter API version.
Machine Learning Research
Multimodal to the Max: 4M-21 multimodal model excels in handling diverse input and output types
Researchers introduced a model that handles an unprecedented number of input and output types, including many related to performing computer vision tasks.
Tech & Society
AI Lobby Expands: AI lobbying surges as U.S. companies ramp up efforts to influence policy
AI is a red-hot topic for lobbyists who aim to influence government policies in the United States.
Generative AI
Agentic Coding Strides Forward: Genie coding assistant outperforms competitors on SWE-bench by over 30 percent
An agentic coding assistant boosted the state of the art in an important benchmark by more than 30 percent.
Science
A Lost Voice Regained: Brain implants paired with neural network reconstruct speech for ALS patient
A man who lost the ability to speak four years ago is sounding like his earlier self, thanks to a collection of brain implants and machine learning models.
Letters
Falling LLM Token Prices and What They Mean for AI Companies: The price of using large language models like GPT-4 is falling dramatically. Here’s how AI companies can capitalize on the trend.
After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).
The Batch Newsletter
AI Restores ALS Patient’s Voice, AI Lobby Grows, Agentic Coding Advances, Massively Multimodal Model
The Batch AI News and Insights: After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens).