Skip to main content
FreelanceJobs logo

AI Tester/ AI QA Engineer – Test Design Review for AI Testing Agent

FreelanceJobs
CAPosted March 4, 2026

Resume Keywords to Include

Make sure these keywords appear in your resume to improve ATS scoring

JiraAPISaaSB2B

Sign up free to auto-tailor your resume with all these keywords and get a higher ATS score

Job Description

We are looking for an experienced QA Engineer with strong test design skills to help us evaluate and improve our AI-based testing agents.

Our product B2B SAAS uses an AI-first SDLC, where part of the QA process is performed by AI agents. One of these agents generates test documentation and test cases, which are later executed by other agents.

For this project, we want to compare the work of an experienced human QA engineer with the output generated by our AI Test Design Agent.

The goal is to understand what the AI does well, what it misses, and how we can improve it.

  • What you will do*You will work with one module of our product and:
  • Review the module functionality and requirements
  • Perform full test design

Create:

  • Test plan
  • Test cases
  • Edge cases
  • Negative scenarios

Perform manual testing of the module

Compare your test design with the output generated by our AI Test Design Agent

Document:

-missing scenarios in AI-generated tests

-weak or incorrect AI test cases

-areas where AI testing can be improved

  • What we provide*-access to the product test environment

-documentation for the module

-access to our AI Test Design Agent

-logs and generated test artifacts

-full support from our engineering team

  • Requirements*-3+ years experience in QA

-strong test design skills

-experience testing AI / LLM systems

-experience creating test plans and test cases

-experience testing complex web products or SaaS systems

  • Nice to have*-API testing experience

-exploratory testing experience

  • Project format*-short project focused on one module

-fully remote

if collaboration works well, we may continue working together on other modules

This is a unique opportunity to work on AI-driven QA systems and help us improve how AI performs software testing.

  • Pool of tasks: 10-15 hours/week*Technical support and documentation provided.

More about the platform:

Contract duration of 3 to 6 months. with 40 hours per week.

Mandatory skills:

Artificial Intelligence, Jira, Test Case Design, Functional Testing, QA Software & Testing Tools, Desktop Application Testing, Web Testing

Want AI-powered job matching?

Upload your resume and get every job scored, your resume tailored, and hiring manager emails found - automatically.

Get Started Free