USA: Automation QA Engineer – Generative AI
RMS IT Solutions Inc· Information Technology And Services· Oct 16, 2026 · 12d ago
Atlanta, GA
Remote
Contract
Principal
$141K–$216K est.
10+ years exp
Job description
•
Home
• /
•
Careers
• /
• USA: Automation QA Engineer – Generative AI
Job Description
WE’RE HIRING: Automation QA Engineer – Generative AI | Remote
Location: Remote (Candidates must be willing to travel to Atlanta, GA, once a month)
Key Skills & Responsibilities:
Strong expertise in Playwright and modern test automation practices.
Hands-on experience in automation testing of GenAI-based applications.
Validate AI-generated responses for relevance, accuracy, completeness, and consistency.
Evaluate hallucination rates, grounding accuracy, latency, and context retention.
Test safety compliance and response consistency.
Define acceptance criteria for AI-generated content.
Experience with automated AI evaluation frameworks and quality scorecards.
Apply for this Position
Job Overview
•
Department:
Engineering
•
Location:
USA
•
Role Type:
Contract
•
Experience Level:
10+ YEARS
•
Required Experience:
10+ YEARS
•
Qualifications:
MS/ BACHELORS
•
Salary / Package:
DOE
Apply For This Job
Ready To Grow With
BusinessTalent & Technology?
Let's discuss how RMS IT Solutions can help
your business achieve its goals.
Get started Today
Chat with us
Application prep
Use the role’s language and application details while tailoring your materials.
Keywords to mirror
ai
- Platform
- careers-html
- Effort
- medium