ML trends

Trends

Our Trends section features key numbers and data visualizations in AI, links to our reports and other sources that showcase the change and growth in AI over time. Last updated on Apr 11, 2023.

Display growth values in:

Training compute growth rate
Likely
0.62 OOM/year
Training
data
Plausible
2024
Most parameters in a dense model
Uncertain
540 billion
GPU price-performance
Likely
0.122 OOM/year
Algorithmic improvements
Plausible
0.4 OOM/year
Training costs growth rate
Likely
0.49 OOM/year

Acknowledgements

We thank Tom Davidson, Lukas Finnveden, Charlie Giattino, Zach-Stein Perlman, Misha Yagudin, Robi Rahman, Jai Vipra, Patrick Levermore, Carl Shulman, Ben Bucknall and Daniel Kokotajlo for their feedback.

Citation

Cite this work as

Epoch (2023), "Key trends and figures in Machine Learning". Published online at epochai.org. Retrieved from: 'https://epochai.org/trends' [online resource]

BibTeX citation

@misc{epoch2023mltrends,
  title = "Key trends and figures in Machine Learning",
  author = {Epoch},
  year = 2023,
  url = {https://epochai.org/trends},
  note = "Accessed: "
}

If you spot an error or would like to provide feedback, please reach out at .