Software Development · Palo Alto, CA

Sr. Software Engineer, Data Platform

SpaceXSI · Palo Alto, CA · Posted Jul 29, 2025

This posting comes from SpaceXSI. Confirm the details on their site before applying.

Overview

The Data Platform team builds and operates the infrastructure responsible for all large-scale data transport and processing across the company. We own and manage core systems including Apache Kafka, HDFS, Spark, Flink, and Trino, enabling real-time ML pipelines, feed ranking, experimentation, analytics, and observability at petabyte scale. Our team deals with latency-critical workloads, high-throughput streaming, and distributed compute systems that require fault tolerance, performance, and absolute reliability.

Responsibilities

  • Design and implement high-throughput, low-latency data ingestion and transport systems
  • Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads
  • Extend and tune Spark, Flink, and Trino for demanding production pipelines
  • Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale
  • Debug and optimize distributed systems, with a focus on reliability and performance under load
  • Collaborate with ML, product, and infrastructure teams to unblock critical data workflows

Requirements

  • Bachelor’s degree in computer science, engineering, math, or technical discipline; OR 5+ years of professional software development experience in lieu of a degree
  • Experience with Kafka, Flink, Spark, Trino, or Hadoop in production

Preferred qualifications

  • Proficiency in Rust, Go, Scala or similar systems languages
  • Proven expertise in distributed systems, stream processing, or large-scale data platforms
  • Strong debugging, profiling, and performance optimization skills
  • Track record of shipping and maintaining critical infrastructure
  • Comfortable working in fast-moving, high-stakes environments with minimal guardrails

Benefits

  • $180,000 - $330,000 USD
  • Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.