Software Development · Sunnyvale, CA

Full-time

(USA) Principal, Software Engineer

Walmart · Sunnyvale, CA · Posted Oct 29, 2026

This posting comes from Walmart. Confirm the details on their site before applying.

Overview

The Principal Software Engineer on Walmart's Private Cloud Storage Engineering team architects and operates some of the largest Ceph storage clusters in the industry, supporting hundreds of petabytes of mission-critical data. This hands-on technical leader drives the design, scalability, performance optimization, and automation of distributed storage platforms across multiple global production environments.

Responsibilities

  • Architect, deploy, and manage large-scale Ceph storage clusters across global production environments, ensuring high availability, durability, and scalability through advanced CRUSH map design, erasure coding, and replication strategies.
  • Design, develop, and maintain Ceph CSI and Cinder CSI drivers to provide persistent, resilient, and high-performance storage services for containerized workloads on Walmart's Cloud Native Platform.
  • Troubleshoot and optimize performance across the storage, Linux, and networking stacks, leveraging tools such as perf, blktrace, bpftrace, and tcpdump to identify and resolve complex bottlenecks.
  • Build and enhance automation for cluster provisioning, lifecycle management, capacity expansion, monitoring, and operations using Ansible, Terraform, and Python.
  • Lead root cause analysis for critical production incidents, mentor engineers on storage architecture and best practices, and contribute to the Ceph and Kubernetes CSI open-source communities.

Requirements

  • 15+ years of experience in distributed storage systems and Linux infrastructure engineering, including 10+ years of hands-on expertise designing, deploying, and operating large-scale Ceph environments at petabyte scale.
  • Extensive experience developing, enhancing, and supporting Ceph CSI and Cinder CSI drivers to provide persistent storage for cloud-native, containerized platforms.
  • Deep knowledge of Linux internals, kernel tuning, storage architectures, and networking technologies, including TCP/IP, BGP, RDMA, BlueStore, RocksDB, OSD architecture, and erasure coding.
  • Strong experience troubleshooting and optimizing system performance using tools such as perf, blktrace, tcpdump, bpftrace, and eBPF, with proven expertise in infrastructure automation using Python, Ansible, and Terraform.
  • Hands-on experience with Kubernetes, OpenStack (Cinder and Swift), and public cloud platforms, including AWS, Azure, and Google Cloud Platform (GCP).

Benefits

  • Health insurance, Dental insurance, 401(k), Paid time off, Paid sick leave, Parental leave, Life insurance, Stock / equity, Bonus

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.