Tech & Society
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Analytics DeepLearning.AI
Tech & Society
Governments Lay Down the Law: Governments around the world increasingly regulate AI.
Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
Tech & Society
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
Machine Learning Research
Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.
If you change an image by moving its subject within the frame, a well trained convolutional neural network may not recognize the fundamental similarity between the two versions. New research aims to make CNN wise to such alterations.
Tech & Society
Troll Recognition: Twitch uses AI to flag trolls who try to avoid bans.
A prominent online streaming service is using a machine learning model to identify trolls who try to get around being banned.
Machine Learning Research
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
DeepMind released three papers that push the boundaries — and examine the issues — of large language models.
Tech & Society
What Makes TikTok Tick: Leaked info reveals how TikTok's algorithm works.
A leaked document gave reporters a glimpse of what makes TikTok’s renowned recommender algorithm so effective.
The Batch Newsletter
The Batch: TikTok's Recommender Revealed, DeepMind's Not-So-Large Language Models, Neural Troll Trap, Recognizing Rotations
We just wrapped up the Data-Centric AI Workshop at the NeurIPS 2021 conference. It was packed with information about how to engineer data for AI systems.
Letters
The NeurIPS Data-Centric AI Workshop Was Amazing!
We just wrapped up the Data-Centric AI Workshop at the NeurIPS 2021 conference. It was packed with information about how to engineer data for AI systems. I wish the whole DeepLearning.AI community could have been there!
Machine Learning Research
Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.
Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.
Tech & Society
Corporate Ethics Counterbalance: Timnit Gebru launches institute for AI fairness.
One year after her acrimonious exit from Google, ethics researcher Timnit Gebru launched an independent institute to study neglected issues in AI.
Machine Learning Research
Recognizing Autism: AI research can help identify autism early in children.
Classical machine learning techniques could help children with autism receive treatment earlier in life. Researchers led by Ishanu Chattopadhyay at University of Chicago developed a system that classified autism in young children based on data collected during routine checkups.