Remote Role: QA Engineer for AI Development Assessment

Be at the forefront of assessing AI coding interactions. We're looking for detail-oriented QA experts to evaluate AI capabilities through remote, task-based engagement. In this position, you will rigorously review transcripts between users and AI coding systems, applying your skills in testing and documentation. The role suits senior or staff engineers, QA specialists, or documentation experts who can provide critical insights into AI performance and user experience. Key Responsibilities:

• Analyze full transcripts of user-AI conversations
• Score dialogues with a comprehensive rubric
• Write justifications for given scores
• Detect inconsistencies in AI execution
• Review multiple transcripts accurately within time limits Requirements:
• Extensive experience in code review or QA methodologies
• Proficiency in Python and familiarity with various programming languages
• Strong technical writing and documentation skills
• Background in development, DevOps, or system analysis preferred
• Ability to work independently with flexible scheduling Enhance the quality of AI development by leveraging your analytical expertise in this innovative evaluation role.