Our partner is seeking talented Coding subject-matter experts (SMEs) from the Software Engineering (SWE) industry to bring deep domain expertise and elevate the quality of our AI training data. This is a remote, flexible opportunity to collaborate directly with the research teams of a leading AI lab.

What You’ll Do

• Guide research teams to close knowledge gaps and improve AI model performance in the SWE coding domain.

• Create and maintain precise annotation standards tailored to coding. As a SWE SME, you’ll set the gold standard for quality and rigor.

• Develop guidelines and detailed rubrics/evaluation frameworks to assess model reasoning across tasks.

• Design challenging, domain-relevant tasks, and write accurate and well-structured solutions to SWE Coding problems.

• Evaluate SWE Coding tasks and solutions and provide clear, written feedback.

• Collaborate with other subject matter experts to ensure consistency and accuracy in training data.

Qualifications

• Location: Currently living in the US

• Education: Master’s Degree+

• Experience: Familiarity with AI and have a minimum of 2+ years of practice experience at a reputable institution. It would be great if you have experience with Algorithms & Data Structures, Full Stack Development, Big Data & Distributed Systems..

• Ideal Commitment:~40hrs/week with a minimum availability of ~20 hrs/week. You’ll join calibration calls with the client’s team 2-5x per week.

What We Offer

• Pay rate between $90 and $100 per hour.

• Long-term (6-12 months) role directly reporting to the research team of a leading AI lab.

• Flexible, remote work that will have a significant impact on the development of advanced AI models.