DevOps Engineer - AI Model Evaluator

mercor

Remote (Portugal) Remote Contract $176.8K/yr 2 days ago
Workplace
Remote
Location
Portugal
Who can apply
Remote for people based in Portugal

Check your CV against this job

Free · No signup · A 0–100 ATS match score and the keywords you're missing.

Check my CV free

Free to start. Already have an account? Log in

About the role

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type:Contract Compensation:$85/hour Location:Remote

Role Responsibilities

* Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. * Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation. * Identify bugs, edge cases, reliability issues, and failure modes in model outputs. * Compare outputs from multiple frontier models to assess strengths and weaknesses. * Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

* 2+ years of professional DevOps, SRE, or Cloud Engineering experience. * Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling. * Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools. * Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

* Experience supporting production-scale systems.

Compensation & Legal

* $400 per accepted task. * Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

* Upload resume * AI interview based on your resume * Submit form

Resources & Support

* For details about the interview process and platform information, please check: * For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas

About remote DevOps Engineer jobs

Open jobs
573 open remote DevOps Engineer jobs, 109 of them posted in the last 7 days. See all Remote DevOps Engineer jobs
Typical advertised pay
$128,000 – $176,000 a year for the middle half of the 103 job ads from 73 employers that state a salary in US dollars (median $158,000). This is base pay as advertised, not total compensation. Remote DevOps Engineer salary
Skills the job ads ask for most
  • CI/CD 82%
  • Kubernetes 67%
  • Terraform 63%
  • Python 61%
  • AWS 58%
  • Infrastructure as Code 58%

Share of the 494 newest postings for the role that name each skill. Resume keywords for DevOps Engineer jobs

Tools and guides for your application

Get matched & apply with FindAJobAI

Upload your resume once. We score every job against your profile, tailor your resume and cover letter, and autofill the application.