Skip to main content
YO IT Consulting logo

AI-Focused Python Developer for Remote Code Evaluation

YO IT Consulting
Full Timemid
CAPosted April 7, 2026

Job Description

Elevate AI performance as a Python Developer dedicated to code evaluation. Participate in enhancing AI systems by rigorously assessing accuracy and reasoning of technical coding solutions in a fully remote setting.

This unique role requires you to evaluate AI-generated programming outputs for clarity and correctness. You will utilize your software engineering skills for thorough testing and fact-checking while providing insightful annotations that improve model responses. Your expertise in LLMs and programming languages will greatly contribute to this innovative work.

Key Responsibilities:

  • Assess accuracy and completeness of AI code responses
  • Conduct rigorous fact-checking with authoritative references
  • Test code outputs and validate their functionality
  • Annotate findings and highlight areas for improvement
  • Ensure model responses follow evaluation guidelines

Requirements

  • BS, MS, or PhD in Computer Science or related discipline
  • Proven experience in software engineering roles
  • Strong proficiency in languages like Python or Java
  • Capable of solving medium to hard coding challenges
  • Experience engaging with LLMs and open-source contributions

Apply your technical expertise to enhance the quality and reliability of AI-generated coding solutions, transforming the landscape of conversational AI.

#J-18808-Ljbffr

Want AI-powered job matching?

Upload your resume and get every job scored, your resume tailored, and hiring manager emails found - automatically.

Get Started Free