Function-based Code Annotator
Design and develop high-quality, function-level algorithm problems covering a wide range of algorithms and data structures, from basic to advanced.
Hiring companyRemoExperts
About the role
Write clear and accurate problem descriptions in both Chinese and English, defining precise input/output formats and constraints.
Design comprehensive and robust test datasets, including edge cases and extreme scenarios, to ensure accurate evaluation and prevent cheating.
Write reference solutions and automatic validation logic, and perform difficulty grading and quality assessment.
Participate in team cross-reviews to ensure the scientific validity, fairness, and innovation of the benchmark.
Required skills
- Experience participating in or creating problems for programming competitions like ACM/ICPC, Codeforces, etc.
- Expertise in algorithms and data structures, with a specialization in at least one area such as graph theory, dynamic programming, or string algorithms.
- Proficient in Python or C/C++ for writing efficient algorithm implementations and validators.
- Excellent problem abstraction skills to transform vague ideas into unambiguous algorithmic problems.
Preferred skills
- Understanding of the capability boundaries and common pitfalls of major Code LLMs.
- Experience writing algorithm blogs or teaching courses.
- Experience in benchmark design or contributions to open-source Online Judge (OJ) systems.
- Skilled in designing complex problems that test the logical reasoning abilities of AI models.
Experience and education
- Background in Computer Science, Software Engineering, Mathematics, or Artificial Intelligence; or experience as an Algorithm Engineer or Software R&D Engineer (Algorithm-focused).
- Experience in evaluating code generation models is a plus.
Eligibility
Work arrangement: Fully remote
Eligible locations: Worldwide
Compensation details
$120–$150 per day.
- USD $120-150/Day, based on skills and experience.
More about the hiring companyRemoExperts
RemoExpertsRepo-based Code Annotator
Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures.
TuringAgentic Life Science Expert
We are seeking Computational Life Sciences experts with strong scientific programming skills to develop complex, realistic tasks for Agentic Life Sciences.