ML Research Scientist - Inference ML
cerebras · United States and Canada
Job description
About the role
Cerebras Systems builds the world's largest AI chip, delivering training and inference speeds over 10 times faster than GPU-based cloud services. As an ML Research Scientist on the Inference ML team, you will invent and evaluate algorithms, methods and model architectures for efficient inference on the Cerebras architecture, working with researchers and engineers to design, prototype, validate and optimize models. The role focuses on speculative decoding, large-model pruning and compression, sparse attention and sparsity-driven techniques for low-latency, high-throughput inference. It is a hybrid position based in Toronto, Ontario, Canada or Sunnyvale, California, USA.
Key responsibilities
- Research and prototype inference algorithms and model architectures that exploit Cerebras hardware, focusing on speculative decoding, pruning/compression, sparse attention and sparsity.
- Design and evaluate new transformer architectures and variants for NLP and computer vision to balance quality, latency, throughput and compute.
- Pursue high-impact research at the intersection of model architecture, inference systems and hardware.
- Train or adapt models and measure inference performance with Cerebras tools to maximize throughput and minimize latency.
- Collaborate with engineering and performance teams to turn research into usable systems, from inception through delivery.
- Publish and present research findings and contribute to open-source releases where appropriate.
Required profile
- PhD in machine learning, computer science or a closely related field with 3+ years of relevant research or industry experience, or a master's degree with an exceptional record of original research and 4+ years of experience.
- Deep understanding of modern ML architectures, generative models in language and/or vision, and inference behavior.
- Evidence of research impact through publications in leading conferences or journals, high-quality preprints, or widely used open-source contributions.
- Preferred: original research in speculative decoding, pruning, compression, sparse attention, quantization, MoE models, sparsity or inference-aware design; experience owning complex ML projects end-to-end; experience designing novel model architectures; familiarity with large-scale model training and deployment.
Required skills
- Strong Python programming and ML frameworks such as PyTorch, Transformers, vLLM or SGLang.
- Ability to reason about model and algorithm performance for inference workloads.
- Preferred: experience optimizing performance on specialized hardware (GPUs, TPUs, HPC interconnects); Triton, CUDA or C++ experience is a plus.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Canada.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 7 hours ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
cerebras
United States and Canada
Related job offers
-
Principal AI Security Engineer
cerebras United States and Canada -
Software Engineer, Kernel Reliability
cerebras United States and Canada -
Technical Lead Manager, Infrastructure Hardware (Server and Network Systems)
cerebras United States and Canada -
Principal Engineer, Identity & Access Management
Questrade Financial Group -
Technical Support Specialist - Telecom
servicetitan Canada Manitoba Remote