Exponential View

Exponential View

Share this post

Exponential View
Exponential View
💡A short history of knowledge technologies
Copy link
Facebook
Email
Notes
More

💡A short history of knowledge technologies

How does OpenAI's latest language model, GPT-3, compare to previous innovations?

Azeem Azhar
Jul 21, 2020
∙ Paid
33

Share this post

Exponential View
Exponential View
💡A short history of knowledge technologies
Copy link
Facebook
Email
Notes
More
4
1
Share

This is a subscriber-only post which I am making open access until July 25th. Please consider subscribing.

How should we think about OpenAI’s new language model, GPT-3?

(For background on GPT-3, please read my essay AI & the Word, EV#277 on massive language models and EV#278 on some recent demos using GPT-3.)

The model, released with a very simple API that allows even people who write code at my level to play with it*, is getting people breathless, probably with good reason. (I also recommend that you read a typically excellent overview of GPT-3 and community reaction to it from Gideon Lichfield’s Technology Review. This also touches on a number of key criticisms around bias, and draws attention to various technical limitations.)

Knowledge matters

Technology helps us manipulate matter, energy or information. Today, courtesy of computation, we tend to start our experiments with manipulating information.

Written records allow us to stand on the shoulders of giants—and, crucially, bring too…

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2025 EPIIPLUS1 Ltd
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More