Data Points
The latest in AI from Feb. 29 to Mar. 6, 2024
This week's top AI news and research stories featured Mistral's new LLMs, a robot chemist, Google's open source LLMs, and a way to make LLMs better at math. But first:
Analytics DeepLearning.AI
The Batch Newsletter
Mistral Living Large, Google's Open Source Challenger, Robot Chemist, Schooling Language Models in Math
The Batch AI News and Insights: Progress on LLM-based agents that can autonomously plan out and execute sequences of actions has been rapid, and I continue to see month-over-month improvements.
Tech & Society
Google Releases Open Source LLMs: All we know about Google's Gemma-7B and Gemma-2B models
Google asserted its open source bona fides with new models. Google released weights for Gemma-7B, an 8.5 billion-parameter large language model intended to run GPUs, and Gemma-2B, a 2.5 billion-parameter version intended for deployment on CPUs and edge devices.
Science
Robot Chemist: RoboChem, a system that outshines human chemists in chemical synthesis efficiency
A robot outperformed human chemists at synthesizing chemicals. Researchers at University of Amsterdam built RoboChem, an integrated robotic system that learned to design light-activated chemical reactions while achieving optimal yields and throughput.
Tech & Society
Mistral AI Extends Its Portfolio: Mistral enhances AI landscape in Europe with Microsoft partnership and new language models.
European AI champion Mistral AI unveiled new large language models and formed an alliance with Microsoft.
Machine Learning Research
Human Feedback Without Reinforcement Learning: Direct Preference Optimization (DPO) fine-tunes pretrained large language models on human preferences without the cumbersome step of reinforcement learning.
Reinforcement learning from human feedback (RLHF) is widely used to fine-tune pretrained models to deliver outputs that align with human preferences. New work aligns pretrained models without the cumbersome step of reinforcement learning.
Machine Learning Research
Swiss Army LLM
The combination of language models that are equipped for retrieval augmented generation can retrieve text from a database to improve their output. Further work extends this capability to retrieve information from any application that comes with an API.
Machine Learning Research
Better, Faster Network Pruning: Researchers devise pruning method that boosts AI speed
Pruning weights from a neural network makes it smaller and faster, but it can take a lot of computation to choose weights that can be removed without degrading the network’s performance.
Tech & Society
OpenAI’s Next Act?: OpenAI sets its sights on autonomous digital assistants.
OpenAI is focusing on autonomous agents that take action on a user’s behalf. The maker of ChatGPT is developing applications designed to automate common digital tasks by controlling apps and devices, The Information reported.
Hardware
Blazing Inference Speed: Groq elevates AI processing speed with advanced chips.
An upstart chip company dramatically accelerates pretrained large language models. Groq offers cloud access to Meta’s Llama 2 and Mistral.ai’s Mixtral at speeds an order of magnitude greater than other AI platforms. Registered users can try it.
Tech & Society
Context Is Everything: Gemini 1.5 Pro, a leap in multimodal AI amid controversy over v1.0
An update of Google’s flagship multimodal model keeps track of colossal inputs, while an earlier version generated some questionable outputs.
Data Points
The latest in AI from Feb. 22 to Feb. 28, 2024
This week's top AI news and research stories featured Google's troubled Gemini launch, OpenAI's next act, Groq's blazing inference speed, and a method for faster network pruning. But first: