Software Development · Remote

Remote Full-time

Member of Technical Staff, Pre-Training Data

Cohere · Remote · Posted Jun 25, 2025

This posting comes from Cohere. Confirm the details on their site before applying.

Overview

As a Machine Learning Engineer specializing in pretraining data, you will play a pivotal role in developing the data pipeline that underpins Cohere’s advanced language models. In this role, you will conduct data ablations to evaluate data quality and construct pre-training data mixtures to enhance model performance. By combining research and engineering, you will bridge the gap between raw data and cutting-edge AI models, directly contributing to improvements in critical training metrics like throughput and accelerator utilization.

Responsibilities

  • Conduct data ablations to assess data quality and experiment with data mixtures to enhance model performance.
  • Develop robust data modeling techniques to ensure datasets are structured and formatted for optimal training efficiency.
  • Research and implement innovative data curation methods, leveraging Cohere’s infrastructure to drive advancements in natural language processing.
  • Collaborate with cross-functional teams, including researchers and engineers, to ensure data pipelines meet the demands of cutting-edge language models.

Requirements

  • Strong software engineering skills, with proficiency in Python and experience building data pipelines.
  • Familiarity with curriculum learning, data mixing and data attribution.
  • Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
  • Experience working with large-scale datasets, including web data, code data, and multilingual corpora.
  • Knowledge of data quality assessment techniques and experimentation with data mixtures.
  • A passion for bridging research and engineering to solve complex data-related challenges in AI model training.

Benefits

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
  • Education & learning stipend for conferences, courses, and coaching.
  • 6 weeks of paid vacation (30 working days!)
  • Budget for traveling to other offices if you are remote, plus an annual company offsite.
  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
  • For those not near an office: a co-working benefit so you can work alongside others in your city.
  • Everyone receives a $500 home office stipend to set up your workspace properly.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.