Building Meta’s GenAI Infrastructure
Hacker News
MARCH 12, 2024
Marking a major investment in Meta’s AI future, we are announcing two 24k GPU clusters. We use this cluster design for Llama 3 training. We built these clusters on top of Grand Teton , OpenRack , and PyTorch and continue to push open innovation across the industry. The other cluster features an NVIDIA Quantum2 InfiniBand fabric.
Let's personalize your content