Building Meta’s GenAI Infrastructure

Marking a major investment in Meta’s AI future, we are announcing two 24k GPU clusters. We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. We use this cluster design for Llama 3 training. We are strongly committed to open [...]


Read More...


The post Building Meta’s GenAI Infrastructure appeared first on Engineering at Meta.


http://dlvr.it/T3z2gC

Komentar

Postingan populer dari blog ini

How Meta enforces purpose limitation via Privacy Aware Infrastructure at scale

Inside Meta’s first smart glasses

Why xHE-AAC is being embraced at Meta