GovernanceTechnical1–3 hoursStarterFree

Estimate how much compute a famous model needed

Use the rule of thumb “training compute ≈ 6 × parameters × training tokens” to estimate the compute behind a model, then compare your answer with Epoch AI’s database.

Download PDFData

Why it matters

Compute thresholds appear in real regulation. Being able to estimate compute, and know how uncertain the estimate is, is a core governance skill.

Output: A one-page estimate with your assumptions laid out.

Steps

0 of 5 done
  1. Pick a model

    10 min

    Choose a model whose parameter count and training tokens have been published (many open models report both).

  2. Do the rough estimate

    20 min

    Multiply 6 × parameters × tokens to get training FLOP. Write the answer in scientific notation, such as 3 × 10²⁴.

  3. Check against Epoch AI

    20 min

    Look the model up in Epoch AI’s data. How close were you? If you are off, find out why.

  4. Turn it into time and money

    30 min

    Estimate how long that would take on a cluster of chips and roughly what it would cost. Say which assumption you are least sure about.

  5. Explain why it matters

    20 min

    Find one law or policy that uses a compute threshold. Is your model above or below it?

Try next

GovernanceA few weeksAdvanced

How much compute did the key AI innovations need?

Could algorithmic progress continue under a compute halt? Catalogue the innovations in a major model paper and estimate the compute used in the experiments behind each, extending published MIRI TGT work.

DataView project
GovernanceA few weeksIntermediate

Are consumer GPUs a problem for export controls?

Export controls target data-centre chips. But consumer hardware keeps getting better, and frontier-level performance reaches it within about a year. Update the analysis with the latest hardware.

DataReading & writingView project

Related projects

Governance1–3 hoursGuided

Plot AI compute trends with real data

Download Epoch AI’s free dataset of notable AI models, chart training compute over time in Python, estimate how fast it grows, and count how many models cross the EU AI Act’s compute threshold.

CodeDataView project
GovernanceA few weeksAdvanced

Could distributed training dodge compute limits?

New methods let models train across many loosely connected computers. Use Epoch AI’s simulator and recent papers to analyse whether this undermines governance based on big data centres.

DataReading & writingView project
Governance1–3 hoursGuided

Explain compute governance to a friend

Why do so many governance proposals focus on chips? Read one key paper and write a jargon-free explainer for someone outside tech.

Reading & writingView project

Further reading

Related mentored projects