DevOps Specialist – AI Coding Agent Evaluation

About the role

We are looking for a DevOps/SRE/Cloud Engineer to evaluate frontier AI coding agents on realistic infrastructure engineering tasks. The work is project‑based, paid per accepted task, and focuses on assessing model‑generated implementations across cloud platforms, Kubernetes, CI/CD, and observability tooling.

Key responsibilities

• Use AI coding agents (e.g., Cursor, Claude Code, Codex, Windsurf, Gemini CLI) to complete complex infrastructure engineering tasks.
• Review and critique model‑generated code for cloud platforms, Kubernetes, Terraform, CI/CD pipelines, and observability solutions.
• Identify bugs, edge cases, reliability issues, and potential failure modes.
• Compare outputs from multiple frontier models and document strengths and weaknesses.
• Apply professional engineering judgment to realistic production‑scale scenarios.

Required profile

• 2+ years of professional experience in DevOps, SRE, or Cloud Engineering.
• Hands‑on experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, and observability tooling.
• Regular use of AI coding agents for development tasks.
• Ability to evaluate model‑generated infrastructure solutions.
• Experience supporting production‑scale systems is a plus.

Required skills

• AWS
• Azure
• Google Cloud Platform (GCP)
• Kubernetes
• Terraform
• CI/CD pipelines
• Observability tooling
• AI coding agents (Cursor, Claude Code, Codex, Windsurf, Gemini CLI)

What we offer

• $85 per hour rate.
• $400 per accepted task (typical tasks take 2‑3 hours after ramp‑up).
• Flexible sprint‑based schedule (12‑24 hour stretches).