Data Science and Analytics · Various locations

AI Engineer - Quality and Post-Training

Glean · Various locations · Posted Oct 23, 2026

This posting comes from Glean. Confirm the details on their site before applying.

Overview

The bottleneck in building reliable and useful AI agents isn't writing code anymore. It's knowing what good looks like, measuring it, and steadily closing the gap. Glean is building the next generation of enterprise AI assistants and autonomous agents that reason, plan, and act across complex, multi-step workflows. This role works at the intersection of applied research, quality, and product engineering to make those systems better.

Responsibilities

  • Use eval results and production traces to improve the entire stack, including the agent harness, model routing, prompts, and retrieval, while weighing quality against latency and cost.
  • Work on post-training models with supervised fine-tuning (SFT) and preference- or reward-based optimization (e.g., DPO, PPO, GRPO), including generating the data for training.
  • Build RL environments for simulating enterprise workflows, including relevant evalsets, harness support, and LLM-based verifiers for hill-climbing and for internal and external benchmarking.
  • Improve the quality of representative evalsets, LLM judges and agentic verifiers, and calibrate them against human graders so the scores can be trusted in release decisions and model training.
  • Work with product, platform, and research teams across Glean to land quality improvements in production.

Requirements

  • 5+ years of industry experience in AI or Machine Learning Engineering.
  • Hands-on experience post-training LLMs including adapting open-weight models to specialized tasks.
  • Experience building evals for AI assistant and agent systems, including generating evalsets, LLM-as-a-judge verifiers, calibrating offline and online signals coupled with good judgment about when a metric reflects quality improvements.
  • Strong coding skills in Python and/or Go (TypeScript is a plus), proficiency in your ML framework of choice, and a track record of shipping production ML systems.
  • Product-minded, able to turn a vague problem into a concrete experiment, and thrive in a tight-knit, cross-functional team.

Benefits

  • The standard base salary range for this position is $200,000 - $280,000 annually.
  • Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience.
  • Certain roles may be eligible for variable compensation, equity, and benefits.
  • We offer a comprehensive benefits package including competitive compensation, Medical, Vision, and Dental coverage, generous time-off policy, and the opportunity to contribute to your 401k plan to support your long-term goals.
  • When you join, you'll receive a home office improvement stipend, as well as an annual education and wellness stipends to support your growth and wellbeing.
  • We foster a vibrant company culture through regular events, and provide healthy lunches daily to keep you fueled and focused.
  • We’re committed to building and sustaining a diverse, inclusive workplace.
  • We strive to attract and retain people with a wide range of backgrounds, experiences, and perspectives, and we do not discriminate on the basis of gender, ethnicity, sexual orientation, religion, civil or family status, age, disability, or race.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.