AI Trends

Our Trends section features key numbers and data visualizations in AI, related Epoch reports and other sources that showcase the change and growth in AI over time.

Last updated on Nov 22, 2023

Display growth values in:

Training compute
Likely
4.2 x/year
Training data
Plausible
2024
Most parameters in a dense model
Uncertain
540 billion
Computational performance
Likely
1.35 x/year
Algorithmic improvements
Plausible
2.5 %/year
Training costs
Likely
3.1 x/year

Acknowledgements

We thank Tom Davidson, Lukas Finnveden, Charlie Giattino, Zach-Stein Perlman, Misha Yagudin, Robi Rahman, Jai Vipra, Patrick Levermore, Carl Shulman, Ben Bucknall and Daniel Kokotajlo for their feedback.

Several people have contributed to the design and maintenance of this dashboard, including Jaime Sevilla, Pablo Villalobos, Anson Ho, Tamay Besiroglu, Ege Erdil, Ben Cottier, Matthew Barnett, David Owen, Robi Rahman, Lennart Heim, Marius Hobbhahn, David Atkinson, Keith Wynroe, Christopher Phenicie, Alex Haase and Edu Roldan.

Citation

Cite this work as

Epoch (2023), "Key trends and figures in Machine Learning". Published online at epochai.org. Retrieved from: 'https://epochai.org/trends' [online resource]

BibTeX citation

@misc{epoch2023aitrends,
  title = "Key trends and figures in Machine Learning",
  author = {Epoch},
  year = 2023,
  url = {https://epochai.org/trends},
  note = "Accessed: "
}

If you spot an error or would like to provide feedback, please reach out at .