Senior Software Engineer (MLOps) – Serving

At Datadog, we’re building an AI Platform that powers ML and LLM features across our observability and security products. The Serving team plays a mission-critical role in this platform: ensuring that trained models can be reliably deployed and served at scale in production, across multiple data centers and compute environments. Our goal is to enable self-serve, performant, and observable model inference workflows. This includes building Ray-based serving infrastructure, deploying infe