Takeoff Atlas & Primer
Takeoff No guesses yet

Growth, from folding paper to AI that improves itself

Short scenes, each with something to press or a guess to make. They start with paper and pond weed, move through chain reactions and epidemics, and end at the equation people use for AI improving AI. The colors mean the same thing all the way through, here and on the other pages.

adding doubling hitting a ceiling faster than doubling slowing down
GrowthAdding, doubling, and limits

Adding vs. doubling

Fold a sheet of paper.

Paper is about a tenth of a millimeter thick. Fold it in half and the stack is twice as thick. Fold it again and it doubles again.

Guess firstHow many folds until the stack reaches the Moon?

0.1 mmFolds: 0Adding 0.1 mm a fold instead: 0.1 mm
Hold to keep folding.

Doubling time

Every growth rate has a doubling time.

Something growing 7% a year doesn’t sound fast, but it doubles every 10 years. There’s a shortcut: divide 70 by the yearly percent. At 7% that’s 10 years, and at 2% it’s 35.

Guess firstA city grows 1% a year. About how long until it’s twice as big?

Tap the things under the chart to compare their doubling times.

10 years

Exponential growth

A lily pad doubles every day.

One pad makes two, two make four. Each day the lilies grow by as much as there already is. On day 30 they cover the whole pond.

Guess firstOn what day was the pond half covered?

Day 0Covered: less than 0.01%
Hold to skip ahead.

Log scales

A ruler where every step is ×10.

On an ordinary chart, steady doubling hugs the floor for a long time and then shoots up the wall, like the bars under the pond. A log scale fixes that. Each gridline is ten times the one below. Most charts about AI growth use one.

Guess firstThese dots are transistor counts on computer chips from 1971 to 2023. On a log scale, what shape will they make?

Normal scaleEach gridline adds 25 billion

Hitting a ceiling

Bacteria double until the food runs out.

This dish has food for about four thousand cells. Each cell splits in two every 20 minutes. So far the colony has doubled six times in a row.

Guess firstWill it keep doubling?

64 cellsAfter 2 hours

Stacked S-curves

One technology levels off. The trend can keep going.

Computers have been built five different ways: punch-card machines, relays, vacuum tubes, transistors, and chips. Each one improved fast, then hit its own limit and flattened into an S.

Guess firstIf every one of them leveled off, can computing as a whole keep growing exponentially?

Punch cardsLevels off by the 1930s
Chain reactionsThings that set off more of themselves

Critical mass

Add uranium until it goes critical.

When a uranium atom splits, it throws out two or three neutrons. If one of them hits another uranium atom, that atom splits too. In a small lump most neutrons fly out the sides before they hit anything, and the chain dies. A bigger lump catches more of them.

The number that matters is k, the average number of new splits each split causes.

Guess firstWhat happens when k is exactly 1?

k ≈ 0.6Neutrons flying: 0 · splits: 0

Epidemics

One sick person, and a number called R.

A disease spreads like a chain reaction. R is how many people each sick person infects. Early COVID-19 had an R around 3. While R stays above 1, cases grow exponentially.

Everyone who recovers is immune for a while. As immunity builds, each sick person finds fewer people left to infect, so R falls on its own.

Guess firstIf R starts at 3, what share of people need to have had it before R drops below 1?

Day 0R right now: 3.0Sick: 0 · had it: 0%

Faster than doubling

Each doubling takes half as long as the last.

The first doubling takes one minute. The next takes 30 seconds, then 15, then 7½, and so on.

Guess firstHow long until it has doubled infinitely many times?

0:00Doublings: 0

The longest chart

The world economy keeps changing gears.

For most of history, growth was too slow for anyone to notice in a lifetime. Farming sped it up, and industry sped it up again. Each era had its own steady doubling time, and each was much shorter than the last.

Guess firstFrom farming to industry, doubling got about 60 times faster. If the next change were that big, how often would the economy double?

The loopAI that improves AI, and the equation behind it

Recursive self-improvement

Each hammer forges a better hammer.

With a crude hammer, a blacksmith makes a slightly better one. The better hammer makes the next one faster and better again. The tool is improving the thing that makes tools.

Recursive self-improvement is the same loop with AI. The AI does research on AI, the research finds an improvement, and the improvement becomes a better AI, which does the next round.

In 1965 the statistician I. J. Good, who had broken codes with Alan Turing during the war, argued that a machine better than people at designing machines could design a better one still. He called what would follow an intelligence explosion.

Loops like this already exist. Each one ran into its own kind of limit.

Machine toolsPrecise lathes made the parts for more precise lathes. Precision improved steadily for two centuries.
Chips designing chipsEach generation of computers runs the software that designs the next. Fifty years of steady doubling.
CompilersMany compilers are written in their own language, so each version compiles the next. Each gain is a single step, with no runaway.
Self-playAlphaGo Zero learned Go by playing itself. In three days it beat the version that beat Lee Sedol, 100 games to 0. Then progress slowed.
People and ideasMore people made more ideas, and ideas fed more people. Faster than doubling for thousands of years, until families shrank.

The loop, as a race

A runner on a track that gets longer every lap.

Here is the whole loop as one picture. Each lap of the track is one round of AI research, and every finished lap makes the AI twice as good.

After each lap, two things change at once.

The runner gets fasterA better AI does research faster.
The track gets longerThe next improvement is harder to find.

Which one grows faster decides everything.

Guess firstThe runner gets 1.5× faster each lap, and the track gets 1.3× longer. What happens to the lap times?

Month 0
All three runners speed up the same. Only the tracks differ.

The same race, in symbols

One symbol at a time.

Economists write the race as one equation. Every symbol in it is one part of the picture you just watched.

Tap a symbol to open its short lesson, or step through them with the arrow.

    = × ÷
    How fast A grows laps per month Rλ how fast the runner goes Aβ how long the track is δ how long the first lap takes

    One number decides it

    Speed-up against slow-down.

    Every time the AI doubles, its research gets 2λ times faster. With λ = 0.6 that’s 1.5×. That’s the runner speeding up.

    And the next doubling needs 2β times as much research as the last one. With β = 0.6 that’s also 1.5×. That’s the track getting longer.

    next lap ÷ this lap=2β÷2λ

    So the laps shrink exactly when λ is bigger than β.

    Guess firstλ = 0.6 and β = 0.4. What does the AI do?

    λ smaller than βThe track wins. Each lap takes longer than the last.
    λ equals βA tie. Every lap takes the same time: steady doubling.
    λ bigger than βThe runner wins. Laps keep shrinking: an explosion.

    Researchers fold the comparison into one number, r = λ ÷ β, called the returns to research. It answers one question: when research effort doubles, how many times does the AI double? If r is above 1, the runner wins. It plays the same role as k in a reactor and R in an epidemic.

    BrakesWhat slows a loop down

    Bottlenecks

    The slowest step sets the pace.

    A round of AI research is more than thinking. Ideas need experiments, experiments need chips, a new model needs months of training, and people check the results.

    Here is one round, 10 months long. You get three upgrades. Each one makes a step ten times faster. Tap a step to upgrade it, and see how fast you can make the round.

    10.0 mo
    One round
    1.0×
    Faster than at the start
    Upgrades left

    Tap a step to make it 10× faster.

    Every runaway stops

    Every loop on this page hit a brake.

    Each runaway here slowed or ended for a reason you can name. Most of the brakes are negative feedback: the growth itself uses up what it needs. A few were chosen by people. The question for AI is which brake bites first, and how hard.

    Chain reactionk falls. Control rods soak up neutrons, the fuel gets used up, and a bomb blows itself apart.
    EpidemicR falls. People become immune, change how they behave, and get vaccinated.
    BacteriaThe food runs out and waste builds up.
    World economyFamilies got smaller as countries got richer, so more output stopped turning into more people with more ideas.
    Moore’s lawEach new chip factory costs more than the last, now tens of billions of dollars, and transistors are approaching the size of atoms.
    AI improving AICompute for experiments, data, power, chips, money, training runs that take months, human review, and ideas getting harder to find.
    Gene splicing, 1974A brake people chose. Biologists paused some of their own experiments, met at Asilomar in 1975, and restarted under safety rules.
    Nuclear powerAnother chosen brake. After Three Mile Island in 1979, cost and regulation stalled new US reactors for about thirty years.
    An AI pauseProposed, never tried. Stopping bigger training runs would hold back the loop, but chips would keep piling up in the meantime. More on the Brakes page.

    The evidence

    So is r above 1?

    Researchers estimate r by looking back at how much better software got each time the research effort behind it doubled.

    Tap the line to place your guess for AI research. Then look at the estimates.

    Your guess: none yet
    Bigger pictureThe math of feedback

    Cybernetics

    Every loop here is a feedback loop.

    In 1948 the mathematician Norbert Wiener named the study of feedback in animals and machines cybernetics. Its central idea is the sign of the loop. Negative feedback pushes against a change, like a thermostat switching the heat off when the room gets warm. Positive feedback pushes along with it, like a microphone held near its own speaker.

    Nudge both and watch what happens. Then give the thermostat a delay.

    Related math

    Where this math comes from.

    Each idea on this page has a field behind it. These are good places to keep going.

    Branching processesGalton and Watson, 1874Started as a question about why family surnames die out. Gives the rule that chains with k below 1 die out and chains above 1 can run away, and the chance a chain dies early by bad luck.Seen in critical mass and the outbreak
    Epidemic modelsKermack and McKendrick, 1927Splits a population into susceptible, infected and recovered, and gives the herd immunity threshold 1 − 1/R.Seen in the outbreak
    Dynamical systemsPoincaré onwardThe study of anything that changes by its own rules. Its tools are fixed points, stability, and bifurcations, where a small change in one number flips the whole behavior, like r crossing 1.Seen in the three labs
    Control theoryMaxwell, 1868, on steam engine governorsHow to steer a system with feedback, and why delays make it overshoot and oscillate.Seen in feedback and the reactor
    Growth theoryRomer, 1990; Jones, 1995The economics of ideas. It’s where the research equation, with its λ and β, comes from.Seen in the equation
    PercolationBroadbent and Hammersley, 1957When does a fire cross a whole forest? Below a certain density of trees it always dies out, above it the fire spreads all the way. It’s the same kind of threshold as k = 1.Seen in critical mass

    Four shapes

    Every curve on this page was one of four.

    Brakes can turn one shape into another. A loop can explode until compute runs short, settle into steady doubling, and then level off at a ceiling.

    Slows downr below 1. Each doubling takes longer than the last, like compilers.
    Steadyr equal to 1. The same doubling time forever, like the lily pond or Moore’s law.
    Levels offRuns into a ceiling, like the bacteria or an epidemic.
    Explodesr above 1. Doublings come faster and faster, like world population until the 1960s.