Meta details Prometheus, its gigawatt-scale supercluster in Ohio, which will have ~1M GPUs at full scale and was used to train its Muse foundational models (Engineering at Meta)
Prometheus has already trained Meta’s Muse models while still scaling toward its planned capacity.
The supercluster is in New Albany, Ohio, and is designed at gigawatt scale. Roughly one million GPUs is the full-scale target. Coverage linked by Techmeme identifies Nvidia GB200 and GB300 NVL72 systems among its hardware.
Techmeme's note
The supercluster is in New Albany, Ohio, and is designed at gigawatt scale. Roughly one million GPUs is the full-scale target. Coverage linked by Techmeme identifies Nvidia GB200 and GB300 NVL72 systems among its hardware.
Techmeme's note
score 7