Senior Engineer – Cloud AI Infrastructure

About the role

Huawei Canada’s Distributed Scheduling and Data Engine Lab is seeking a Senior Engineer to design and build next‑generation cloud infrastructure for AI and agentic workloads. The role sits at the intersection of research, systems engineering, and product innovation, translating emerging AI trends into scalable solutions.

Key responsibilities

• Track and analyze trends in LLMs, agentic AI, and multi‑step agent workflows to guide infrastructure direction.
• Investigate and resolve bottlenecks across GPU/NPU utilization, data movement, memory hierarchy, and distributed execution.
• Design system‑level architectures for agent execution frameworks, multi‑model orchestration, and large‑scale inference systems.
• Evaluate AI/agent workload requirements on cloud and hybrid platforms, balancing cost, performance, and scalability.
• Collaborate with engineering and product teams to prototype and deliver production‑ready solutions grounded in research.

Required profile

• Strong foundation in distributed systems, cloud infrastructure, or systems engineering with hands‑on experience building large‑scale systems.
• Proficiency with Kubernetes, cluster scheduling, or equivalent orchestration platforms in production.
• Practical experience with AI/ML systems, including training pipelines or inference infrastructure.
• Research‑oriented mindset comfortable reading papers, running experiments, and prototyping ideas.

Required skills

• Kubernetes and cluster scheduling.
• Programming in Go or C++.
• Experience with LLM serving frameworks such as vLLM, SGLang, Triton, or Ray.
• GPU/NPU optimization and understanding of hardware constraints.
• Distributed systems and cloud infrastructure design.