AI and compute
Analysis showing AI training compute doubles every 3.4 months (vs. Moore's Law's 2-year period), with 300,000x growth since 2012, quantifying a key driver of AI progress.
Excerpt
We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction]. Since 2012, this metric has grown by more than 300,000x (a 2-year doubling period would yield only a 7x increase). Improvements in compute have been a key component of AI progress, so as long as this trend continues, it’s worth preparing for the implications of systems far outside today’s capabilities.
Read at source: https://openai.com/index/ai-and-compute