Wu Dao 2.0 - The Batch | DeepLearning.AI

Tech & Society

China’s LLMs Open Up: Alibaba’s new open source LLMs

The latest wave of large language models trained in Chinese is open source for some users. Internet giant Alibaba released large language models that are freely available to smaller organizations.

Interviews & Essays

Yoav Shoham: Language models that reason

I believe that natural language processing in 2022 will re-embrace symbolic reasoning, harmonizing it with the statistical operation of modern neural networks. Let me explain what I mean by this.

Illustration of giant Christmas tree in a town plaza

Tech & Society

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

Two images showing RETRO Architecture and Gopher (280B) vs State of the Art

Machine Learning Research

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

Business

GPT-3 for All: GPT-3 NLP Model is Available for Select Azure Users

Microsoft is making GPT-3 available to selected customers through its Azure cloud service.