Software Engineer, AI Evaluation

Job Description:

• Review proposed coding tasks and programming environments for realism
• Provide technical feedback on the structure and difficulty of evaluation harnesses
• Walk through the approach to verifying complex code challenges
• Suggest improvements to make test suites more robust
• Participate in an AI-moderated session focused on coding evaluation harnesses

Requirements:

• Professional software engineer based in South Asia
• Experience building or reviewing realistic programming tasks
• Familiarity with coding evaluation harnesses or test automation
• Comfortable discussing technical workflows in an interview setting
• Backend development, test automation, or full-stack engineering background
• Experience building and reviewing complex codebases
• Hands-on experience verifying realistic programming tasks in professional environments

Benefits:

• Paid study participation
• Paid interview