1. Home
  2. Jobs
  3. Python Engineer
  4. Senior Python Engineer - LLM Evaluation, Part-Time AI Review - Remote (United States)
OpenTrain AI logoOA
OpenTrain AIopentrain.ai

Senior Python Engineer - LLM Evaluation, Part-Time AI Review - Remote (United States)

United States (Remote)Part-time7 days ago

OpenTrain AI is hiring for this role.

• Pay: Not specified in the available role details.

• 100% remote

• Part-time independent contractor

• At least 20 hours a week

Use your senior Python expertise on flexible remote contract work evaluating AI-generated code.

Coding models are trained and benchmarked on code that experienced engineers prepare and review. Your judgment decides what counts as a correct, efficient and reliable solution, and the checks you design measure how the model compares with performance benchmarks.

## What you will do

• Choose code examples and write exact programming solutions for training datasets.

• Review AI-written code and improve its correctness, efficiency, scalability and reliability.

• Build Python agents and automated tools that check solutions and surface error patterns.

• Rate the model on prototyping, architecture and API design, building, launch, experiments, monitoring and maintenance, contributing code in Python, Go, Java, Rust, C/C++ or JavaScript with ReactJS.

## Who this is for

• Three or more years of software engineering experience.

• Strong Python, including production frameworks, tooling and best practices.

• Experience building full-stack applications and shipping scalable software.

• Solid knowledge of software architecture, debugging, development and code review, and familiarity with backend services, data pipelines or ML infrastructure.

• You can write clear, structured explanations of technical evaluations.

• Fluent in English.

• Helpful: high-scale production systems and a strong computer science foundation; practical engineering skill counts alongside formal education.

• No AI experience needed.

## Why this is worth your time

• Pay: Not specified in the available role details.

• Use senior Python judgment on how AI coding models are trained and benchmarked.

• Design the checks that decide whether a coding solution passes.

• Fully remote and flexible, no fixed shifts, no commute

## Pay and details

• Pay: Not specified in the available role details.

• Independent contractor.

• Part-time, flexible schedule; fully remote, United States; at least 20 hours a week.

## How to apply

1. Apply on OpenTrain with your resume: https://app.opentrain.ai/api/out/cmw4vczw0001408l56g3ii727?ch=getaicareers&sub=p_be19ca43fcc8

2. Complete the application on the hiring platform.

3. If shortlisted, take a conversational AI interview with technical questions and a coding challenge, whenever it suits you.

Ready to use your senior Python expertise to evaluate AI-generated code? Apply on OpenTrain.

## About OpenTrain AI

OpenTrain AI is an open talent network for AI training and data labeling with self-service hiring and managed service options.