Software Development · Santa Clara, CA

Full-time

Senior Software Engineer, AI Data

NVIDIA · Santa Clara, CA · Posted Nov 9, 2026

This posting comes from NVIDIA. Confirm the details on their site before applying.

Overview

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Research Superclusters (MARS), builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems.

Responsibilities

  • Design and build the AI data layer for a multi-cloud GPU fleet: how datasets, checkpoints and scratch data are placed, cached, tiered and moved between different storage backends.
  • Build high-throughput data paths for training and RL. That means streaming loaders from object storage, distributed caches, and checkpoint save and restore at thousands of GPUs, including peer-to-peer and local-first restore.
  • Make data a first-class part of the compute platform. Build Kubernetes-native APIs, operators and storage integrations so a job declares the data it needs, and the platform mounts, caches and accounts for it, on Slurm and on Kubernetes.
  • Own quotas, capacity and data lifecycle across hundreds of research teams: usage attribution, quota enforcement, retention, clean-up of stale data, and forecasting capacity before it runs out.
  • Measure how workloads use data. Build I/O telemetry and access analytics that show hot and cold data, metadata pressure and I/O stalls, and use them to drive placement and fixes.
  • Own reliability for what you build: on-call, incident analysis, and changes that stop whole classes of data incidents, such as full file systems, runaway metadata load and lost checkpoints.
  • BS or MS in Computer Science, Computer Engineering, Electrical Engineering or a related field, or equivalent experience.
  • 5+ years building production systems or data-infrastructure software.
  • Deep experience with at least one of the following: parallel or distributed file systems (Lustre, WEKA, VAST, GPFS, Ceph or similar), object storage at scale (S3 or compatible), or large-scale data pipelines and data lakes.
  • A clear grasp of I/O performance: throughput, latency, metadata cost, caching and how access patterns interact with each.
  • Strong programming in Go, Rust, C or C++, plus Python for tooling and analysis.
  • A track record of owning a service in production and making it measurably better.
  • Clear written and spoken communication with engineers and researchers.

Preferred qualifications

  • Experience feeding large-scale AI training: data loaders, streaming datasets, and storage behavior at thousands of GPUs.
  • Experience with checkpointing at scale: asynchronous or distributed checkpoints, tiered checkpoint storage, fast restart after failure.
  • Built or ran a distributed cache or AI-oriented storage system, or used node-local NVMe as a managed tier.
  • Built a quota, accounting or capacity system that many teams depended on.
  • Knowledge of RL and agentic workloads and what they need from storage: many small reads, environment snapshots, sandbox images and fast fan-out.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.