Software Development · San Francisco, CA

Staff Software Engineer- Foundation Model Inference

Databricks · San Francisco, CA · Posted Jul 24, 2026

This posting comes from Databricks. Confirm the details on their site before applying.

Overview

P-1930 As part of the AI team, you'll build the platforms and products that power everything from data apps, AI agents, model training, model serving, and Vector Search. You'll be joining a high-agency, high-visibility team operating at the frontier of AI infrastructure — with deep ties to research, product, and real-world enterprise use cases. Databricks Mosaic AI is one of our fastest-growing businesses, helping thousands of our customers democratize AI within their organizations.

Responsibilities

  • Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
  • Improve reliability, latency, and efficiency of distributed AI workloads
  • Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
  • Shape how developers and data scientists build and interact with AI on Databricks

Requirements

  • 8+ years of experience in backend or infrastructure engineering
  • Experience with distributed systems, scalable APIs, or cloud-native infrastructure
  • Experience with real-time serving, ML infrastructure, or GPU orchestration
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability

Preferred qualifications

  • Exposure to platforms like SageMaker, Vertex AI, or Azure ML
  • Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang
  • Built developer platforms or internal tools supporting AI workflows

Benefits

  • Databricks is committed to fair and equitable compensation practices.
  • The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles.
  • Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location.
  • Based on the factors above, Databricks anticipates utilizing the full width of the range.
  • The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above.
  • For more information regarding which range your location is in visit our page here.
  • Local Pay Range
  • $190,000—$265,000 USD
  • At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees.
  • For specific details on the benefits offered in your region click here.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.