Skip to content
Meta Engineering Blog·· 16 d agoAI score40

Meta Andromeda: Meta's Next-Gen Ads Retrieval Engine Hits 1B Ads per Second

Meta Andromeda: Powering the Next Generation of Ads Retrieval Through Model-System Co-Design

AI summary

Meta detailed the next generation of Andromeda, its personalized ads retrieval engine, which scores over one billion ads per second in production — a 100x throughput lift over the 2024 system. The new architecture brings LLM-inspired mixture-of-experts to retrieval, approaching ranking-level model performance at roughly 300x fewer inference-time FLOPs, with over 10 billion ads per second on a single NVIDIA GH200 GPU. Since 2025, Andromeda has delivered a 2.4% increase in conversions on Facebook.

Source:Meta Engineering Blog · engineering.fb.com