Tulip: Modernizing Meta’s data platform

The technical journey discusses the motivations, challenges, and technical solutions employed for warehouse schematization, especially a change to the wire serialization format employed in Meta’s data platform for data interchange related to Warehouse Analytics Logging. Here, we discuss the engineering, scaling, and nontechnical challenges of modernizing  Meta’s exabyte-scale data platform by migrating to the new [...] Read More... The post Tulip: Modernizing Meta’s data platform appeared first on Engineering at Meta.
http://dlvr.it/ShTYlR

Komentar

Postingan populer dari blog ini

How Meta enforces purpose limitation via Privacy Aware Infrastructure at scale

Inside Meta’s first smart glasses

Fully Sharded Data Parallel: faster AI training with fewer GPUs