When OpenAI released GPT-3 in July, it marked the first time a general-purpose AI saw the light of the day. In an overview of the history of knowledge technologies that preceded it, I wrote:
Creating a generalisable tool for actually answering the question you wanted answering was hard. People believed it required lots of knowledge about the world to be explicitly encoded in specific ways. The Cyc project (now Cycorp) tackled this area for 30 years before launching commercially. […] What GPT-3 has achieved is to encapsulate knowledge, billions of words of it, in a sufficiently parameterised model that it can give granular answers to very different types of queries, across multiple domains. It can also follow quite complex instructions across those domains. […] In a sense, it does something the search engine doesn’t do, but which we want it to do. It is capable of synthesizing the information and presenting it in a near usable form. (This demo of an answer engine that goes one step beyo…