AI Trainer (SWE) | Remote - Contract

Xperteez Technology
Contract type
Ongoing
Work mode
Remote
Experience
3 years

Job description

Software Engineers with prior professional AI-training or model-evaluation experience are needed to support a project focused on improving advanced AI systems. They create challenging technical tasks, evaluate model-generated code, and establish objective standards for correct solutions.

At a glance

Work mode
Remote

What you'll do

  • Create realistic software engineering tasks that challenge advanced AI models.
  • Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
  • Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
  • Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

What we're looking for

  • Prior paid experience training, evaluating, benchmarking, or improving AI systems.
  • Strong practical proficiency with Python.
  • Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
  • Strong knowledge of software design, debugging, testing, version control, and dependency management.
  • Public proof of skill such as substantial GitHub or GitLab repositories, meaningful open-source contributions, maintainer or core-contributor responsibilities, programming-competition results, public developer tools, libraries, systems, or technical projects, or technical publications, benchmarks, or engineering write-ups.

Nice to have

  • Experience creating AI-training tasks, reference solutions, tests, graders, or benchmark problems.
  • Experience reviewing other AI trainers' technical submissions.
  • Codeforces rating of approximately 1900 or higher, or strong results in another programming competition.
  • Experience with Linux, Docker, CI/CD, command-line tools, or sandboxed environments.
  • Prior experience with long-horizon or agentic coding evaluations.
  • Availability to begin immediately.

How to get hired

  1. 1Submit your application, AI-training experience, and public technical evidence.
  2. 2Complete an AI interview containing technical and integrity checks.
  3. 3Complete a hiring-manager review.
  4. 4If selected, complete project onboarding and begin your first assigned task.

Apply