Training and Development · Mountain View, CA

2027 Summer Intern, PhD, Machine Learning - Simulation & Closed-Loop Training

Waymo · Mountain View, CA · Posted Oct 19, 2026

This posting comes from Waymo. Confirm the details on their site before applying.

Overview

Software Engineering builds the brains of Waymo's fully autonomous driving technology. Our software allows the Waymo Driver to perceive the world around it, make the right decision for every situation, and deliver people safely to their destinations. We think deeply and solve complex technical challenges in areas like robotics, perception, decision-making and deep learning, while collaborating with hardware and systems engineers.

Responsibilities

  • Design, implement, and scale Reinforcement Learning post-training and distillation algorithms (such as flow or diffusion policy optimization, off-policy importance sampling, and constrained multi-objective RL) for foundation world models in simulation and autonomous driving
  • Develop learned reward models, realism critics, and discriminators within a closed-loop multi-agent simulator to align simulated agent and driving behaviors with human driving realism and safety
  • Run rigorous closed-loop ablation studies on large-scale TPU clusters—leveraging agentic auto-research workflows and fleet-scale driving behavior metrics (such as route progress, braking comfort, lateral stability, and lane selection)—to mitigate simulator exploitation and distribution shift
  • Write clean, modular, and well-tested JAX code in core simulation and autonomous driving codebases, collaborating closely with researchers and engineers across simulation, world modeling, and autonomous driving teams

Requirements

  • Currently pursuing a PhD in Computer Science, Machine Learning, Robotics, or a related technical field, with an anticipated graduation date between December 2027 and August 2028 (returning to a degree program for at least one academic term after the internship)
  • Core Implementation Fluency (Mandatory): Strong tensor implementation and debugging skills in Python and JAX/Flax or PyTorch, with hands-on experience training and modifying modern neural architectures (such as Transformers, Diffusion/Flow models, or deep RL networks)
  • Deep Research Expertise in Either (a) Reinforcement Learning & Post-Training (hands-on research experience in policy gradient methods such as PPO/GRPO/REINFORCE, off-policy or offline RL such as importance sampling/AWR/DPO, constrained MDPs, inverse RL, or learned reward and critic modeling) OR (b)…
  • First-author publications at top-tier machine learning or robotics venues (e.g., NeurIPS, ICML, ICLR, CVPR, CoRL, RSS, ICRA, or equivalent venues) in RL post-training, flow/diffusion policy optimization, generative world models, or autonomous driving
  • Experience with multi-agent closed-loop simulation, Sim2Real transfer, or reward-hacking mitigation (e.g., Waymax, WOMD, NuPlan, IsaacGym/MuJoCo, adversarial traffic generation, or discriminator stabilization)
  • Experience profiling and scaling distributed training workloads on TPUs or multi-node GPUs (such as XLA compilation, vectorized batched rollouts, and memory optimization) and familiarity with C++/Python interfaces

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.