Suraj Singh

Distributed systems engineer, 13+ years. Currently building LLM inference infrastructure at Meta. Previously AWS OpenSearch.

Projects

• Preventing hot shards and increasing throughput in OpenSearch — why I reversed my own design
• We stop every write to switch the primary, and lose none — primary failover in OpenSearch
• LLM inference at Meta — scheduling, KV-cache, latency at scale
• Killing the crash loop — 52 crashes to zero
• Cutting runtime by 80% — coming soon

Elsewhere

• LinkedIn
• Resume