Principal Software Engineer - Cloud AI Infrastructure

About the role

Integrate AI frameworks with Huawei Cloud infrastructure to optimize end‑to‑end architecture for AI inference and fine‑tuning scenarios. The role focuses on improving observability, reliability and performance of AI services while collaborating on prototype design and validation.

Key responsibilities

• Integrate AI frameworks with cloud infrastructure and enhance observability, reliability and performance of AI services.
• Design and develop concept prototypes in collaboration with team members.
• Validate optimization strategies to ensure their effectiveness.
• Work closely with the product team to support prototype development, considering product constraints and requirements.

Required profile

• Minimum 5 years of software development experience, including at least 2 years in AI infrastructure R&D for fine‑tuning or inference.
• Proficiency in Golang or Rust with ability to write clean, efficient code from scratch.
• In‑depth understanding of AI technologies and model training, inference frameworks and storage systems.
• Experience with Kubernetes or Ray and developing services on these platforms.
• Strong knowledge of cloud services such as AWS and Azure.
• Analytical problem‑solving skills and ability to address complex technical challenges.
• Self‑driven learner with a Master’s or Ph.D. in Computer Science, Engineering or related field, or equivalent practical experience.

Required skills

• Golang
• Rust
• Kubernetes
• Ray
• AWS
• Azure
• AI workload profiling tools
• vLLM
• SGLang