Research Engineer – Multimodal AI & Interaction

About the role

Join Huawei's Human-Machine Interaction Lab in Markham to research and build next‑generation multimodal AI capabilities for intelligent consumer devices, spanning speech, vision, language, touch, gesture and contextual sensing.

Key responsibilities

• Research, design and implement multimodal AI models for perception, reasoning, interaction and generation.
• Identify high‑impact research problems and drive projects from exploration through prototype to product‑oriented validation.
• Design, train, fine‑tune and evaluate deep‑learning and foundation models across modalities.
• Develop novel cross‑modal reasoning approaches to enable natural, adaptive human‑machine interaction.
• Rapidly prototype ideas, reproduce state‑of‑the‑art methods and evolve them into robust demonstrations.
• Build datasets, define evaluation methodologies and establish metrics that reflect both model performance and real interaction quality.
• Optimize models for real‑world constraints such as latency, memory, power, privacy and on‑device deployment.
• Contribute reproducible code, documentation and intellectual property through publications, patents or open‑source releases.

Required profile

• Master's or PhD in Computer Science, Electrical/Computer Engineering, AI, ML, Statistics, HCI or related field (exceptional Bachelors considered).
• Strong foundation in machine learning/deep learning with hands‑on experience in PyTorch, TensorFlow or JAX.
• Technical depth in multimodal learning, speech/audio, computer vision, NLP or generative AI.
• Experience with LLMs/VLMs, agentic AI, multi‑agent systems or context‑aware intelligent systems is a strong asset.
• Track record of turning research into working systems (prototypes, open‑source, patents, publications or shipped products).
• End‑to‑end ML development experience: data preparation, training, evaluation, debugging, optimization and deployment.
• 3+ years of relevant research or industry experience and strong Python programming skills (Typescript/Kotlin, C++/Java a plus).
• Collaborative mindset and ability to work across research, engineering and product teams.

Required skills

• Python
• PyTorch
• TensorFlow
• JAX
• Multimodal learning
• Speech/audio processing
• Computer vision
• Natural language processing
• Generative AI
• Foundation models
• Large language models (LLMs)
• Vision‑language models (VLMs)
• On‑device deployment
• Data preparation
• Model training
• Model evaluation
• Model optimization
• C++
• Java
• Typescript
• Kotlin