Job description

Job Title: Business Analyst – Verification Engineer (QA) Company: BLN24 About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client’s end-state, and then seamlessly integrating within each Agency’s organization to improve and enhance strategic and technical operations and deployments. Position Overview: BLN24 is seeking a Business Analyst – Verification Engineer (Quality Assurance) to support human-level validation activities associated with Gen-AI led test- driven design processes. In this role, you will ensure AI-generated outputs are thoroughly evaluated, validated, and consistently aligned with established system expectations, business requirements, and operational workflows. The ideal candidate will collaborate closely with cross-functional teams, including developers, business analysts, product owners, and AI engineering teams to identify discrepancies, analyze AI-generated results, and refine verification processes that uphold system integrity and quality. This position requires strong analytical skills, attention to detail, and the ability to design and execute validation scenarios that challenge both AI-driven outputs and underlying system logic. Key Responsibilities: • Support human-level validations for Gen-AI led test-driven design processes. • Ensure AI-generated output consistently aligns with business and system expectations. • Collaborate with cross-functional teams to refine and validate AI-driven solutions. • Identify, analyze, document, and report discrepancies between AI outputs and expected system behaviors. • Develop and execute test cases, validation scenarios, and quality assurance procedures. • Support continuous improvement of verification methodologies, validation frameworks, and QA processes. • Participate in requirements analysis, workflow validation, and user acceptance testing activities. • Assist with tracking validation results, defects, and remediation activities using issue management tools. • Analyze system behaviors, AI responses, and operational outcomes to improve solution accuracy and reliability. • Support Agile development and iterative testing processes within AI-enabled environments. Required Qualifications: • Bachelor’s degree in information systems, Computer Science, Business, Engineering, or related field. • 1+ year of experience in Quality Assurance, Verification & Validation (V&V), Business Analysis, or software testing. • Experience supporting human-level validation or QA processes for AI-driven or automated systems. • Familiarity with test-driven development methodologies and QA best practices. • Knowledge of automated testing tools, validation frameworks, or AI model evaluation concepts. • Experience with defect tracking and collaboration tools such as Jira, Azure DevOps, or similar platforms. • Strong analytical, troubleshooting, and communication skills. • Ability to work collaboratively within cross-functional Agile teams. Preferred Qualifications: • Experience with AI/ML-enabled systems or Gen-AI validation processes. • Experience supporting Federal or enterprise environments preferred. Technical Skills: • Quality Assurance (QA) • Verification & Validation (V&V) • Gen-AI Output Validation • Test Case Development • Defect Tracking and Analysis • Agile Methodologies • Jira / Azure DevOps • Data Analysis and Troubleshooting • Continuous Improvement Processes What BLN24 brings to the Game: BLN24 benefits are game changing. We like our team to play hard and that means they need to be taken care of — physically, financially, and emotionally. We make sure to keep them in the game by giving them access to generous medical, dental, and vision plans. • You can join one of the fastest growing companies headquartered in the Washington DC Metro Area. We give you the opportunity to work in different sectors, so you have the chance at variety while maintaining stability. • Flexibility at BLN24 allows each individual the opportunity to balance quality work and their personal lives. Depending on projects, we allow remote working opportunities so you can always be in the game no matter where you call home. BLN24 is an Equal Opportunity Employer. We believe people are our strength and understand diverse talents are key to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. In accordance with applicable law, we make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as any mental health or physical disability needs.

Requirements

Must-haves

Job Title: Business Analyst – Verification Engineer (QA)
Company: BLN24
About Us: We find strength in teamwork-a better you is a better us
BLN24 is seeking a Business Analyst – Verification Engineer (Quality Assurance)
to support human-level validation activities associated with Gen-AI led test-
driven design processes. In this role, you will ensure AI-generated outputs are
thoroughly evaluated, validated, and consistently aligned with established system
expectations, business requirements, and operational workflows.
The ideal candidate will collaborate closely with cross-functional teams, including
developers, business analysts, product owners, and AI engineering teams to
identify discrepancies, analyze AI-generated results, and refine verification
processes that uphold system integrity and quality. This position requires strong
analytical skills, attention to detail, and the ability to design and execute
validation scenarios that challenge both AI-driven outputs and underlying system
Key Responsibilities: • Support human-level validations for Gen-AI led test-driven design processes.
Ensure AI-generated output consistently aligns with business and system expectations.
Collaborate with cross-functional teams to refine and validate AI-driven solutions.
Identify, analyze, document, and report discrepancies between AI outputs and expected system behaviors.
Develop and execute test cases, validation scenarios, and quality assurance procedures.
Support continuous improvement of verification methodologies, validation frameworks, and QA processes.
Participate in requirements analysis, workflow validation, and user acceptance testing activities.
Assist with tracking validation results, defects, and remediation activities using issue management tools.

Nice-to-haves

Preferred Qualifications: • Experience with AI/ML-enabled systems or Gen-AI validation processes.
Experience supporting Federal or enterprise environments preferred.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aiagilejiraazureml

Platform: jazzhr
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision