Tech & Society
Parsing Commands Into Actions: NLP Helps Google Robot Understand Spoken Instructions
A new method enables robots to respond helpfully to verbal commands by pairing a natural language model with a repertoire of existing skills.
Transformer
Business
Chipmaker Boosts AI as a Service: Nvidia Launches Cloud Service for NLP Models
Nvidia, known for chips designed to process AI systems, is providing access to large language models. Nvidia announced early access to NeMo LLM and BioNeMo, cloud-computing services that enable developers to generate text and biological sequences respectively.
Machine Learning Research
Update Any Language Model: New Method to Update Pretrained Language Models
The ability to update language models is essential to incorporate new information and correct undesirable behaviors. Previous methods are unwieldy and often fail as the amount of new data increases. New work offers a workaround.
Machine Learning Research
Attention to Rows and Columns: Altering Transformers' Self-Attention Mechanism for Greater Efficiency
A new approach alters transformers' self-attention mechanism to balance computational efficiency with performance on vision tasks.
Machine Learning Research
Object-Detection Transformers Simplified: New Research Improves Object Detection With Vision Transformers
ViTDet, a new system from Facebook, adds an object detector to a plain pretrained transformer.
Tech & Society
Large Language Models Unbound: BLOOM is the Largest Open Source NLP Model to Date
A worldwide collaboration produced the biggest open source language model to date. BLOOM is a family of language models built by the BigScience Research Workshop, a collective of over 1,000 researchers from 250 institutions around the globe.
Machine Learning Research
Choose the Right Annotators: Jury-Learning Helps Remove Bias from NLP Models
A new machine learning method attempts to account for biases that may be held by certain subsets of labelers.
Machine Learning Research
Humanized Training for Robot Arms: New Research Improves Robot Performance and Adaptability
Robots trained via reinforcement learning usually study videos of robots performing the task at hand. A new approach used videos of humans to pre-train robotic arms.
Science
Cutting the Carbon Cost of Training: A New Tool Helps NLP Models Lower Their Gas Emissions
You can reduce your model’s carbon emissions by being choosy about when and where you train it.
Tech & Society
Text-to-Image Goes Viral: Inside Craiyon, Formerly Known as DALL·E Mini
A homebrew re-creation of OpenAI’s DALL·E model is the latest internet sensation. Craiyon has been generating around 50,000 user-prompted images daily, thanks to its ability to produce visual mashups like Darth Vader ice fishing and photorealistic Pokemon characters.
Machine Learning Research
A Transformer for Graphs: New Method for Processing Graph Data with Transformers
Transformers can learn a lot from sequential data like words in a book, but they’ve shown limited ability to learn from data in the form of a graph. A new transformer variant gives graphs due attention.
Machine Learning Research
Pile on the Layers!: DeepNorm Allows Transformers to Accommodate More Layers
Adding layers to a neural network puts the “deep” in deep learning, but it also increases the chance that the network will get stuck during training. A new approach effectively trains transformers with an order of magnitude more layers than previous methods.