Letters
The Spirit of Giving in AI and Beyond
As we approach the end of 2021, you may be winding down work and gearing up for the winter holiday. I’m looking forward to taking a break from work and hope you are too.
Latest
Tech & Society
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Tech & Society
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
Tech & Society
Governments Lay Down the Law: Governments around the world increasingly regulate AI.
Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
Tech & Society
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
Machine Learning Research
Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.
If you change an image by moving its subject within the frame, a well trained convolutional neural network may not recognize the fundamental similarity between the two versions. New research aims to make CNN wise to such alterations.
Tech & Society
Troll Recognition: Twitch uses AI to flag trolls who try to avoid bans.
A prominent online streaming service is using a machine learning model to identify trolls who try to get around being banned.
Machine Learning Research
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
Tech & Society
What Makes TikTok Tick: Leaked info reveals how TikTok's algorithm works.
A leaked document gave reporters a glimpse of what makes TikTok’s renowned recommender algorithm so effective.
The Batch Newsletter
The Batch: TikTok's Recommender Revealed, DeepMind's Not-So-Large Language Models, Neural Troll Trap, Recognizing Rotations
We just wrapped up the Data-Centric AI Workshop at the NeurIPS 2021 conference. It was packed with information about how to engineer data for AI systems.
Letters
The NeurIPS Data-Centric AI Workshop Was Amazing!
We just wrapped up the Data-Centric AI Workshop at the NeurIPS 2021 conference. It was packed with information about how to engineer data for AI systems. I wish the whole DeepLearning.AI community could have been there!
Machine Learning Research
Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.
Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.