How many parameters does GPT-3 have?

Technology hard Data from 2020

Guess before you scroll — the answer is below

Answer in parameters. Shorthand like 9m or 1.2bn works.

The answer

175,000,000,000 parameters

Roughly 175B.

GPT-3 was published in 2020 with 175 billion parameters, more than 100 times its predecessor. Parameter counts stopped being the headline shortly after: newer models are often smaller but trained on far more data, and most labs no longer disclose the number at all.

Where this number comes from

Source Brown et al., Language Models are Few-Shot Learners
Figure refers to 2020
Last checked
Unit parameters

Numbers move. If this one has drifted from its source, let us know.

Think you can do better?

Five fresh questions every day. No account needed.

Play today’s puzzle

Related questions