Senior Member of Technical Staff, Web Data

About the role

Cohere is seeking a Senior Member of Technical Staff to lead the development of large‑scale web data pipelines that feed its cutting‑edge language models. You will transform raw, noisy internet data into high‑quality training corpora and collaborate closely with research and engineering teams.

Key responsibilities

• Maintain and scale pipelines for processing massive web corpora.
• Design and implement filtering and quality‑scoring systems to surface high‑value documents.
• Analyze data composition across domains, languages, and time periods.
• Develop and sustain high‑performance deduplication pipelines.
• Partner with researchers and engineers to ensure data pipelines meet model requirements.

Required profile

• Strong software engineering background with expertise in Python.
• Experience with data‑processing frameworks such as Apache Spark, Apache Beam, or Pandas.
• Proven track record working with large‑scale web datasets.
• Knowledge of data‑quality assessment techniques and experimentation with data mixtures.
• Passion for bridging research and engineering to solve complex AI data challenges.

Required skills

• Python
• Apache Spark
• Apache Beam
• Pandas

What we offer

• Weekly lunch stipend of $75 (or equivalent).
• Full health, dental, and mental‑health benefits.
• RRSP matching, 401K, and pension scheme.
• 100% parental‑leave top‑up for up to six months.
• Annual enrichment benefits for arts, fitness, and workspace improvements.
• Education stipend for conferences, courses, and coaching.
• Six weeks of paid vacation (30 working days).
• Travel budget for office visits and an annual company off‑site.
• $500 home‑office setup stipend.