Job description

Company Description Lumen Solutions Group Inc. is a technology consulting Services company based in Florida. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and Enterprise Transformation. Role: Software Engineer – AI/ML QA Engineer Location: Columbia, MD / Washington, DC (Hybrid – Required once in a Week) Job Type: 6 Months Contract (Possible Extension) Job Summary: We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills. Key Responsibilities: • Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows. • Develop test strategies for AI-powered applications and non-deterministic GenAI outputs. • Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications. • Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks. • Test Salesforce Einstein and integrations with external LLM/AI platforms. • Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs. • Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety. • Write and execute complex SQL queries across multiple databases, with strong Oracle experience. • Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies. • Participate in Agile ceremonies and maintain project documentation using Jira and Confluence. Required Qualifications • 3+ years of Software Engineering experience. • 1–2 years of hands-on AI/ML/Generative AI project experience. • 3+ years of Cloud experience with AWS, GCP, or another major cloud platform. • Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses. • Strong hands-on experience with Selenium, BDD, and test automation. • Experience with API, UI, manual, and automation testing. • Strong SQL skills and experience with Oracle. • Understanding of relational and non-relational databases. • Understanding of data pipelines and ability to validate intermediate pipeline outputs. • Experience working with Jira and Confluence. • Bachelor's degree required; technical degree preferred. Nice to Have • Experience with AWS Bedrock and/or SageMaker. • Experience with AI/ML testing frameworks. Lumen Solutions Group Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.

Requirements

Must-haves

Company Description
Role: Software Engineer – AI/ML QA Engineer
Location: Columbia, MD / Washington, DC (Hybrid – Required once in a Week)
Job Type: 6 Months Contract (Possible Extension)
Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.
Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
Test Salesforce Einstein and integrations with external LLM/AI platforms.
Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety.
Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.
3+ years of Software Engineering experience.
1–2 years of hands-on AI/ML/Generative AI project experience.
3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
Strong hands-on experience with Selenium, BDD, and test automation.
Experience with API, UI, manual, and automation testing.

Nice-to-haves

Bachelor's degree required; technical degree preferred.
Experience with AWS Bedrock and/or SageMaker.
Experience with AI/ML testing frameworks.
Lumen Solutions Group Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlsqlllmapiagilejiraawsgcp

Platform: jobdiva
Effort: medium