The AI job market, made clearer

Find work worth
your expertise.

Added 17 Oct 2026New on Thriveth

Senior Software Engineer – LLM Evaluation

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers.

Remote

Hiring companyTuring

Application process2.0 / 5Based on 1 review

Work experienceN/ANo approved reviews yet

About the role

This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding solutions.

Duration:1 month (starting next week; potential extensions based on performance and fit).

Responsibilities

Working on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable.
Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks.
Build agents that can verify the quality of the code and identify error patterns.
Hypothetize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operation maintenance) and evaluate model capabilities on them.
Design verification mechanisms that can automatically verify a solution to a software engineering task.

Required skills

Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
Excellent oral and written communication skills for clear, structured evaluation rationales.

Experience and education

Several years of software engineering experience, including 2+ years of continuous full-time experience at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research).

Schedule details

Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week (partial PST overlap required).

Eligibility

Work arrangement: Fully remote

Compensation details

Type: Contractor (no medical/paid leave).

More about the hiring companyTuring

Ready to apply?

Apply with Thriveth referral

Referral disclosure

Thriveth may earn a referral payment if you use the referral link and meet the company’s conditions. Your choice does not improve your chances or change how this job is shown.

View referral details

Thriveth may earn a referral bonus if you use this link and meet Turing’s referral conditions. Using the referral link is optional and does not improve your selection chances or affect how we present the listing. Rewards vary by role. Turing determines whether a referral qualifies. Generally, the candidate must be new to Turing, the referral must be credited to the first referrer through Turing’s portal or public referral page, and the candidate must be hired, complete onboarding, and meet the required work milestone—normally at least 10 worked hours. Candidates already in Turing’s applicant system, already under consideration or otherwise known to Turing, current or former employees or contractors, and candidates who applied directly within the previous 90 days do not qualify under the reviewed terms. Referrers must obtain consent before submitting a candidate’s personal information. Rewards remain subject to Turing’s current terms, eligibility checks, and program changes; payment is not guaranteed. Thriveth is independent of Turing. Using it does not affect job order, ratings, or reviews.

Apply without referral

Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.

Find work worthyour expertise.