Overview
Work closely with Product and Research engineering teams to prototype, experiment with, evaluate, and productionize new AI capabilities. Design, build, and operate scalable, highly available backend services and distributed systems supporting AI/ML workloads. Develop and optimize model routing and inference infrastructure across multiple LLM and model providers, balancing latency, throughput, reliability, and cost.