Exponential View by Azeem Azhar

Share this post

πŸ€– Weekly commentary: The machine that builds itself

www.exponentialview.co

πŸ€– Weekly commentary: The machine that builds itself

Wow.

Azeem Azhar
Oct 10, 2022
42
2
Share this post

πŸ€– Weekly commentary: The machine that builds itself

www.exponentialview.co

Wow. DeepMind announced AlphaTensor, a neural network which has unlocked novel mathematical algorithms. Using an extension to AlphaZero (its general games playing engine), AlphaTensor has improved a key piece of fundamental mathematics: matrix multiplication.Β 

Wow. I said that before, yes. The real wow is that matrix multiplication is the heart of modern deep learning. A typical neural network will conduct billions, trillions of such multiplications. In fact, the demand for matrix multiplications has increased polynomially in the past decade (and one reason why graphics processing units have taken off as the table computing system for AI.)

Wow. Here is why it matters.

This post is for paid subscribers

Already a paid subscriber? Sign in
Previous
Next
Β© 2023 EPIIPLUS1 Ltd
Privacy βˆ™ Terms βˆ™ Collection notice
Start WritingGet the app
SubstackΒ is the home for great writing