Software Development · San Francisco, CA

Full-time

Senior Software Engineer, ML Serving Platform

DoorDash USA · San Francisco, CA · Posted Nov 12, 2026

This posting comes from DoorDash USA. Confirm the details on their site before applying.

Overview

DoorDash’s ML Serving Platform delivers tens of millions of predictions per second across DoorDash, Wolt, and Deliveroo, powering search, recommendations, advertising, and logistics. We build request routing, online feature retrieval, and CPU/GPU inference capabilities that help ML and product teams deploy and operate models independently. We’re looking for a hands-on senior engineer to lead core serving investments.

Responsibilities

  • Lead projects from customer problem through design, implementation, and rollout. Coordinate delivery across engineers, mentor peers, and help shape the team’s roadmap.
  • Improve inference performance through production traces, load tests, and CPU/GPU profiling. Work with model owners to balance model quality, tail latency, throughput, and cost.
  • Partner with Compute on capacity, placement, and scaling, accounting for request complexity, cache state, GPU memory, and model startup behavior.
  • Build self-serve APIs and deployment workflows that manage models, runtime dependencies, features, and versioned state, with validation, safe rollout, and rollback.
  • Evaluate, integrate, and extend open source tools and vendor capabilities that advance model serving. Decide when to build or adopt, and collaborate with maintainers and vendors.
  • Own production reliability through service objectives, observability, on-call, incident response, and follow-through. Reduce recurring operational work through automation.

Requirements

  • You have 6+ years of software engineering experience designing, building, and operating production infrastructure or distributed systems.
  • You have hands-on experience serving large or complex neural models online, with accountability for latency, availability, and resource efficiency.
  • You bring strong distributed systems fundamentals and proficiency in a backend or systems language such as Python, Go, Java, Kotlin, or C++.
  • You understand inference tradeoffs across batching, concurrency, caching, memory, and CPU/GPU utilization, and can diagnose production bottlenecks.
  • You have operated services on Kubernetes or comparable infrastructure, including resource configuration, autoscaling, and failure recovery.
  • You’ve led substantial projects through ambiguity, partnered with fast-moving ML or product teams, and helped other engineers grow.
  • You hold a degree in Computer Science or a related field, or have equivalent practical experience.

Preferred qualifications

  • Experience integrating or extending inference tools such as Triton Inference Server or PyTorch.
  • Experience with multi-GPU inference, model parallelism, model-aware caching, or accelerator scheduling.
  • Experience building model workflows, deployment tooling, or instrumentation with Metaflow, Helm, or OpenTelemetry.

Benefits

  • For salaried roles: flexible paid time off/vacation, plus 80 hours of paid sick time per year.
  • For hourly roles: vacation accrued at about 1 hour for every 25.97 hours worked (e.g. about 6.7 hours/month if working 40 hours/week; about 3.4 hours/month if working 20 hours/week), and paid sick time accrued at 1 hour for every 30 hours worked (e.g.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.