Overview
The AI Model Serving team is the engine behind every production Workday agent and machine learning use case. We own the services that power all production AI workloads, acting as both the gateway to vendor-hosted LLMs (GCP, AWS Bedrock, Gemini) and the primary platform where Workday hosts and scales its internal models. We operate at scale, hosting thousands of traditional ML models across sharded Ray Serve clusters and maintaining Workday's production model registry.