Machine Learning Research
Massively More Training Text: Harvard unveils a million-book corpus for AI training
Harvard University amassed a huge new text corpus for training machine learning models.
Natural Language Processing
Tech & Society
Chatbot Cage Match: Chatbot Arena compares chatbots side-by-side.
A new online tool ranks chatbots by pitting them against each other in head-to-head competitions. Chatbot Arena allows users to prompt two large language models simultaneously and identify the one that delivers the best responses.
Tech & Society
Toward Machines That LOL: Scientists Teach a Speech Recognition Robot to Laugh
Even if we manage to stop robots from taking over the world, they may still have the last laugh. Researchers at Kyoto University developed a series of neural networks that enable a robot engaged in spoken conversation to chortle along with its human interlocutor.
Tech & Society
Large Language Models Unbound: BLOOM is the Largest Open Source NLP Model to Date
A worldwide collaboration produced the biggest open source language model to date. BLOOM is a family of language models built by the BigScience Research Workshop, a collective of over 1,000 researchers from 250 institutions around the globe.
Science
Cutting the Carbon Cost of Training: A New Tool Helps NLP Models Lower Their Gas Emissions
You can reduce your model’s carbon emissions by being choosy about when and where you train it.
Business
Order in the Court: Machine Learning Tool from Everlaw Finds Legal Evidence
Machine learning is helping lawyers sift through mountains of documents to find evidence. The legal technology company Everlaw launched a clustering feature that automatically organizes up to 25 million documents for lawyers gathering evidence to be used during a trial.
Tech & Society
LaMDA Comes Alive?: Google Engineer Says LaMDA AI is Sentient
A chatbot persuaded at least one person that it has feelings. A senior engineer at Google announced his belief that the company’s latest conversational language model is sentient.
The Batch Newsletter
The Batch: Special Issue! Foundational Algorithms, Where They Came From, Where They're Going
Years ago, I had to choose between a neural network and a decision tree learning algorithm. It was necessary to pick an efficient one, because we planned to apply the algorithm to a very large set of users on a limited compute budget.
Tech & Society
Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained
What kind of beast was Aristotle? The philosopher's follower Porphyry, who lived in Syria during the third century, came up with a logical way to answer the question...
Tech & Society
Neural Networks: Find the Function — A Basic Introduction to Neural Networks
Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture.
Tech & Society
Logistic Regression: Follow the Curve — A Basic Introduction to Logistic Regression for Machine Learning
There was a moment when logistic regression was used to classify just one thing: If you drink a vial of poison, are you likely to be labeled “living” or “deceased”? Times have changed.
Tech & Society
GPT-Free: Meta Releases Open Source Large Language Models OPT
Itching to get your hands on a fully trained large language model? The wait is over. Meta introduced the OPT family of transformer-based language models with nearly unfettered access to source code and trained weights.