metaai·lightalo unofficial · independent
Universe / On-Device & Silicon / GPU superclusters: 350K H100s → Prometheus & Hyperion
On-Device & Silicon · 2024

GPU superclusters: 350K H100s → Prometheus & Hyperion

Gigawatt-scale factories for intelligence

closed / product

Latest: Prometheus online 2026 (~1GW); Hyperion expanded to 5GW, $50B+ (Jul 2026)

The compute behind everything: Zuckerberg pledged 350,000 H100s (~600K H100-equivalents) by end of 2024; Llama 3 trained on twin 24,576-GPU clusters. The next act is gigawatt-scale 'titan clusters' — Prometheus (Ohio, coming online 2026) and Hyperion (Louisiana), expanded in July 2026 from 2GW to 5GW at a cost topping $50 billion. 2026 AI capex: $115-135B.

Why it matters

The compute that made Llama and Muse possible: two 24,576-GPU H100 clusters trained Llama 3, on the way to 350,000 H100s (about 600,000 H100-equivalents) by end of 2024. The next step is gigawatt-scale Prometheus and Hyperion, the latter expanded to 5GW in July 2026, backed by $115-135B of 2026 AI capex.

Facts

Try it yourself

Sources

More in On-Device & Silicon

MobileLLMQuantized Llama 3.2Meta LLM CompilerMTIAMobileLLM-R1 / R1.5MobileLLM-Pro

Read the On-Device & Silicon story on the sky →

✦ Open on the map Explore On-Device & Silicon Quiz me