Machine Learning Research
A relatively small student LLM that learns to mimic a larger teacher model can perform nearly as well as the teacher while using much less computation. It can come even closer if the teacher also teaches reasoning techniques.
Tech & Society
The United States and China opened a dialogue to avert hypothetical AI catastrophes.
Tech & Society
OpenAI models were used in five disinformation campaigns, the company said.
Tech & Society
Generative AI plays a starring role in the latest Windows PCs.
Data Points
This week's top AI stories feature a new model from Mistral designed for coding, Microsoft’s updated Phi-3 family of small language models, OpenAI’s new safety and security team, and a family of models from Cohere that supports 23 global languages:
Letters
A barrier to faster progress in generative AI is evaluations (evals), particularly of custom AI applications that generate free-form text.
The Batch Newsletter
The Batch AI News and Insights: A barrier to faster progress in generative AI is evaluations (evals), particularly of custom AI applications that generate free-form text.
Machine Learning Research
Text excerpts used in retrieval augmented generation (RAG) tend to be short. Researchers used summarization to pack more relevant context into the same amount of text.
Tech & Society
AI could offer paths to promotion and relief from busywork for many knowledge workers.
Tech & Society
Few makers of self-driving cars have braved the streets of India. Native startups are filling the gap.
Science
A deep learning model significantly reduced deaths among critically ill hospital patients.
Data Points
This week's top AI news and research stories featured everything we know about OpenAI's GPT-4o, highlights from Google’s annual I/O developers’ conference, Sony Music's declaration opting out of AI training, and details about Meta's Emu Edit model. But first: