AIThe Story of AI
Chapter Five · 2017–2022

When AI Learned to Talk

A paper called "Attention Is All You Need" changed everything. Then came GPT, DALL-E, and a chatbot named ChatGPT.

In 2017, eight scientists at Google wrote a paper with a really cool name: "Attention Is All You Need." It introduced something called the Transformer, a new kind of AI brain that could pay "attention" to all the words in a sentence at the same time, instead of reading them one by one. This was a HUGE deal because it helped computers finally start to understand language almost like humans do. The Transformer became the secret recipe behind almost every famous AI you've heard of today.

After that, AI labs went wild building bigger and bigger language brains. Google made BERT in 2018 to help search engines understand questions better. A company called OpenAI made GPT-1 (2018), GPT-2 (2019), and then GPT-3 (2020) — each one MUCH smarter than the last because it was trained on tons of text from the internet. Soon AI wasn't just reading words, it was writing stories, poems, and even computer code (with GitHub Copilot in 2021). DeepMind even used AI to solve a 50-year-old science mystery called protein folding with AlphaFold.

Then things got really fun. AI learned to draw! DALL-E (2021), Midjourney, and Stable Diffusion (both 2022) could turn any sentence into amazing artwork. Finally, on November 30, 2022, OpenAI launched ChatGPT, a chatbot anyone could talk to for free. It hit 100 million users in just two months — the fastest-growing app ever — and that's the moment AI went totally mainstream.

§

Five Years of Stunning Firsts

June 2017
"Attention Is All You Need"
Google researchers introduce the Transformer architecture.
June 2018
GPT-1
OpenAI releases the first Generative Pre-trained Transformer.
Oct 2018
Google's BERT
Search engines suddenly get way better at understanding questions.
Feb 2019
GPT-2
OpenAI said it was almost "too dangerous" to share at first.
June 2020
GPT-3
175 billion parameters — a giant leap in AI ability.
Jan 2021
DALL-E
OpenAI reveals an AI that creates pictures from text descriptions.
June 2021
GitHub Copilot
An AI assistant that helps programmers write code.
July 2021
AlphaFold 2
DeepMind solves protein folding, predicting 200 million protein shapes.
Aug 2022
Stable Diffusion & Midjourney
AI image generators go viral and free for everyone.
Nov 30, 2022
ChatGPT Launches
AI goes mainstream worldwide.

What Is a "Large Language Model" (LLM)?

A Large Language Model is a giant AI brain that has read almost the entire internet — billions of books, websites, and articles. By reading SO much text, it learns patterns about how words fit together. When you ask it a question, it predicts the best next words, one at a time, kind of like the world's smartest autocomplete. "Large" means it has billions of tiny knobs (called parameters) that get adjusted during training. ChatGPT, GPT-3, and BERT are all examples of LLMs.

§

Three Wild Moments

01

The Avocado Armchair

When DALL-E was first shown off in 2021, one of its most famous pictures was an "armchair in the shape of an avocado." It became the most iconic AI image ever — proof that AI had a weird and creative imagination.

02

ChatGPT Broke Records

It reached 100 million users in just 2 months. For comparison, TikTok took 9 months and Instagram took 2.5 years to hit that number!

03

A 50-Year-Old Puzzle

Scientists had been trying to figure out how proteins fold since the 1970s. AlphaFold cracked it and gave away the shapes of nearly every known protein for free — helping researchers fight diseases like malaria and cancer.

The cat sat there The cat sat there "cat" pays most attention to "sat"
The Transformer's big idea: every word can pay "attention" to every other word at the same time — just like you do when reading a sentence.

GPT Models Got Bigger and Bigger

Number of parameters ("knobs") in each model. Bigger = smarter.

117 M GPT-1 (2018) 1.5 B GPT-2 (2019) 175 B GPT-3 (2020) ~1.7 T* GPT-4 (2023) PARAMETERS
From 117 million to over a trillion parameters in just five years. *GPT-4 size is estimated — OpenAI hasn't confirmed.
It hit 100 million users in just two months — the fastest-growing app ever — and that's the moment AI went totally mainstream.
— ChatGPT, November 30, 2022