Oct 13, 2021

5 Posts

AI Has a Web Problem, Google Goes Multimodal, Unfinished Symphony Completed, Transformers Get Faster Still
Oct 13, 2021

AI Has a Web Problem, Google Goes Multimodal, Unfinished Symphony Completed, Transformers Get Faster Still

I’ve seen many friends transition from an academic or research role to a corporate role. The most successful ones adjusted to corporate work by shifting their mindset in a few crucial ways.

10 min read
Crawl the Web, Absorb the Bias
Oct 13, 2021

Crawl the Web, Absorb the Bias

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.

2 min read
Transformer Speed-Up Sped Up
Oct 13, 2021

Transformer Speed-Up Sped Up

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces

2 min read
Search Goes Multimodal
Oct 13, 2021

Search Goes Multimodal

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.

2 min read
Roll Over, Beethoven
Oct 13, 2021

Roll Over, Beethoven

Ludwig van Beethoven died before he completed what would have been his tenth and final symphony. A team of computer scientists and music scholars approximated the music that might have been.

2 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox