You will assess solutions for correctness, code quality, performance, and adherence to the prompt; identify errors in logic, architecture, or methodology; fact-check technical information; craft clear, step-by-step explanations and exemplary solutions; and rate and compare multiple AI responses based on their reasoning quality and implementation soundness. This is a fully remote, hourly paid contractor role with SME Careers, a fast-growing AI data services company and subsidiary of SuperAnnotate that provides AI training data to many of the world’s largest AI companies and foundation model labs, where your Python expertise will directly help improve the world’s premier AI models.

• Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
• Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
• Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.

• Bachelor’s degree or higher in Computer Science, Software Engineering, Mathematics, or a closely related technical field.
• 7+ years of professional software engineering experience, with significant hands-on work in Python on production systems.
• Deep knowledge of Python language features, the standard library, and common ecosystems such as web frameworks, data tooling, or backend services.
• Strong understanding of algorithms, data structures, system design, and performance optimization in Python applications.
• Proven experience designing, reviewing, and improving high-quality Python codebases, including code review and mentoring responsibilities.
• Minimum C1 English proficiency (written and spoken), with the ability to write clear technical explanations and follow detailed English-language guidelines.
• Comfort working with modern tooling such as version control systems, CI/CD pipelines, testing frameworks, and containerization technologies.
• Previous experience with AI data training, annotation, or evaluating AI-generated technical content is a strong plus.
• Highly detail-oriented, with a structured and methodical approach to evaluating reasoning quality and identifying subtle errors in technical solutions.
• Minimum C1 Chinese proficiency (written and spoken).

Interview required.

Work arrangement: Fully remote

Applicant eligibility: 21 eligible countries