Software Development · Pune, India

Full-time

Senior System Software Engineer - Local AI

NVIDIA · Pune, India · Posted Oct 19, 2026

This posting comes from NVIDIA. Confirm the details on their site before applying.

Overview

NVIDIA has continuously reinvented itself for over two decades. The invention of the GPU in 1999 fueled the growth of PC gaming, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning has ignited modern AI, positioning NVIDIA as a leading AI computing company. Artificial intelligence is shifting from passive assistance to autonomous, always-on workflows.

Responsibilities

  • Partner across organizations with benchmarking teams, inference teams, and AI application developers to define requirements, design, and maintain shared infrastructure for deploying, benchmarking, and qualifying AI workloads across infernece backends such as llama.cpp, Ollama, PyTorch, vLLM, and…
  • Build Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware platforms, operating systems, and runtime configurations.
  • Develop model management services to download, version, cache, and synchronize checkpoints and dependencies for reproducible execution.
  • Design databases, backend services, and data pipelines to store and query model metadata, benchmark results, system telemetry, and execution artifacts.
  • Create dashboards and reports that help engineers compare inference configurations, identify regressions, and investigate performance bottlenecks.
  • Develop and operate server infrastructure, including environment provisioning, workload scheduling, resource management, and failure recovery.
  • Develop autonomous AI agents for infrastructure management, workload orchestration, monitoring, and diagnostics, with appropriate access controls and execution safeguards.
  • Maintain Git repositories and companion websites, keeping code, documentation, model recommendations, and evaluation results current.
  • Collaborate with inference developers to implement instrumentation and debugging capabilities, resolve system issues, and improve infrastructure efficiency and scalability.
  • B.Tech or higher degree in Computer Science, Computer Engineering, Information Technology, Software Engineering, or a related field, or equivalent experience.
  • 5+ years of relevant software development, with strong programming skills in Python, C/C++, C#, or another systems programming language.
  • Experience developing system software, backend services, or infrastructure supporting engineering development.
  • Understanding of system APIs, multithreading, process and resource management, and systems debugging.
  • Hands-on with Git-based CI, databases, SQL, and data modeling.
  • Strong analytical and problem-solving skills, with the ability to independently own projects and manage competing priorities.

Preferred qualifications

  • Track record of integrating or debugging AI inference frameworks and building model evaluation or benchmarking platforms
  • Proficiency working with AI agents, including tool integration and evaluation of autonomous infrastructure workflows.
  • Hands-on expertise in developing telemetry and observability systems using tools such as Grafana or Kibana.
  • Demonstrated ability to publish technical documentation, model recommendations, or benchmark results through companion websites.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.