Member of Technical Staff, Pre-Training Data

About the role

Cohere is looking for a Machine Learning Engineer focused on pre‑training data to build and maintain the data pipelines that power its advanced language models. You will combine research and engineering to turn raw data into high‑quality training material, directly influencing model performance and efficiency.

Key responsibilities

• Conduct data ablations to assess data quality and experiment with data mixtures to improve model performance.
• Develop robust data modeling techniques to ensure datasets are structured for optimal training efficiency.
• Research and implement innovative data curation methods using Cohere’s infrastructure.
• Collaborate with researchers and engineers to meet the demands of cutting‑edge language models.

Required profile

• Strong software engineering skills with proficiency in Python and experience building data pipelines.
• Familiarity with curriculum learning, data mixing, and data attribution.
• Experience with data processing frameworks such as Apache Spark, Apache Beam, or Pandas.
• Hands‑on experience handling large‑scale datasets, including web, code, and multilingual corpora.
• Knowledge of data quality assessment techniques and experimentation with data mixtures.
• Passion for bridging research and engineering to solve complex data challenges in AI model training.

Required skills

• Python
• Apache Spark
• Apache Beam
• Pandas

What we offer

• Weekly lunch stipend of $75 (or equivalent in local currency).
• Full health and dental benefits, plus a mental‑health budget.
• RRSP matching, 401(k), and pension scheme.
• 100% parental leave top‑up for up to six months.
• Annual enrichment benefits for arts, culture, fitness, and workspace improvements.
• Education stipend for conferences, courses, and coaching.
• Six weeks of paid vacation (30 working days).
• Travel budget for office visits and an annual company off‑site.
• $500 home‑office stipend and co‑working benefit for remote employees.