Skip to main content
Spruce InfoTech Inc. logo

Automation Test Engineer – Java/Python (AI / GenAI Testing)

Spruce InfoTech Inc.
CAPosted March 6, 2026

Resume Keywords to Include

Make sure these keywords appear in your resume to improve ATS scoring

PythonJavaCI/CDAPI

Sign up free to auto-tailor your resume with all these keywords and get a higher ATS score

Job Description

Job Title: Automation Test Engineer – Java/Python (AI / GenAI Testing)

Location: Toronto, ON (Hybrid)

6+Months

Must Have: Automation Testing, Python/Java, RAG & LLM, AI/GenAI

Job Description

We are seeking an Automation Engineer with strong experience in Java or Python and exposure to AI/GenAI testing. The ideal candidate will be responsible for building automated test frameworks and validating AI-powered applications, including systems using RAG (Retrieval-Augmented Generation) and LLMs (Large Language Models).

Required Skills

  • Strong experience in test automation using Java or Python.
  • Experience with API testing and automation tools.
  • Basic understanding or exposure to AI/GenAI, RAG, and LLM-based applications.
  • Knowledge of automation frameworks and CI/CD practices.

Nice to Have

  • Experience testing chatbots or AI-based applications.
  • Understanding of prompt testing, hallucination validation, and AI response evaluation.

Want AI-powered job matching?

Upload your resume and get every job scored, your resume tailored, and hiring manager emails found - automatically.

Get Started Free