Job description

This position is ideal for a senior QA automation architect who is passionate about quality, enjoys creating scalable simulation systems, and is eager to contribute to scalable validations using cutting-edge AI products. In this role, you will help design and build automation frameworks and tools with scale in mind and drive adoption through cross-functional partnerships. 7+ years of professional experience in quality engineering, with a strong emphasis on designing, implementing, and optimizing large-scale automation frameworks BS/MS in Computer Science or related field Proven experience in developing robust, maintainable, extensible, and scalable automation solutions. Experience identifying automation requirements and designing solutions to address test execution challenges. Experience leveraging emerging technologies like AI, ML, and LLMs to automate and optimize digital content workflows and advance content validation automation strategies Strong organizational skills and experience working with multiple stakeholders Deep knowledge of Agentic AI and LLM driven test frameworks Solid understanding of automated software testing methodologies and lifecycle, including integration testing, component mocking, and dependency injection Experience Testing AI Models for accuracy, robustness, fairness, and performance Experience developing LLM based automated evaluation frameworks 3+ years of proven ability in machine learning, including hands-on work with LLMs

Requirements

Must-haves

This position is ideal for a senior QA automation architect who is passionate about quality, enjoys creating scalable simulation systems, and is eager to contribute to scalable validations using cutting-edge AI products.
In this role, you will help design and build automation frameworks and tools with scale in mind and drive adoption through cross-functional partnerships.
7+ years of professional experience in quality engineering, with a strong emphasis on designing, implementing, and optimizing large-scale automation frameworks
BS/MS in Computer Science or related field
Proven experience in developing robust, maintainable, extensible, and scalable automation solutions. Experience identifying automation requirements and designing solutions to address test execution challenges.
Experience leveraging emerging technologies like AI, ML, and LLMs to automate and optimize digital content workflows and advance content validation automation strategies
Strong organizational skills and experience working with multiple stakeholders
Deep knowledge of Agentic AI and LLM driven test frameworks
Solid understanding of automated software testing methodologies and lifecycle, including integration testing, component mocking, and dependency injection
Experience Testing AI Models for accuracy, robustness, fairness, and performance
Experience developing LLM based automated evaluation frameworks
3+ years of proven ability in machine learning, including hands-on work with LLMs

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlllmmachine learning

Platform: apple
Effort: medium