Job description

Azusa Solutions is seeking an AI Mid Software Engineer to join our team of talented consultants. This is an exciting opportunity to join a growing company comprised of highly qualified, highly impactful, and multi-talented individuals. We are seeking an AI Engineer with strong technical acumen, creativity, and problem‑solving ability to design, implement, and optimize AI‑powered solutions built on modern agentic frameworks. In this role, you will develop intelligent workflows using foundation models (e.g., Claude Sonnet, Claude Opus, etc.), configure multi‑agent systems, integrate AI with enterprise applications and data systems, and iteratively tune and evaluate agent behavior to deliver reliable, real‑world outcomes. You will collaborate closely with a community of generative AI specialists, software engineers, data scientists, solution architects, cybersecurity experts, and product owners to deliver innovative, production‑ready AI systems that transform our clients’ ecosystems and reinvent the way they operate. Eligibility *Candidate must hold an active Top Secret Clearance* *Candidate must be local to the DC, Maryland, or Northern Virginia area.* Key Responsibilities: • Design, build, and optimize agentic AI systems using orchestration frameworks like LangGraph, CrewAI, Google ADK, or AWS Bedrock AgentCore, etc. • Implement multi‑step, tool‑enabled AI agentic workflows that combine LLM reasoning, RAG, retrieval systems, external APIs, and custom enterprise tools. • Use leading foundation models (Claude Sonnet, Claude Opus, , etc.) on Amazon Bedrock to build capabilities including structured generation, extraction, summarization, planning, and decision support. • Iteratively tune and refine AI workflows through prompt engineering, instruction design, agent configuration, and tool‑use optimization. • Conduct structured testing and evaluation of AI behavior, including regression tests, scenario‑based evaluations, synthetic test creation, and model‑to‑model comparisons. • Diagnose issues such as hallucinations, retrieval mismatches, tool‑use errors, or unexpected agent behavior, and implement corrective strategies including guardrails and workflow adjustments. • Integrate AI components with vector databases, graph databases, internal applications, and other infrastructure tools—working alongside engineers who manage the underlying systems. • Document model usage patterns, agent behaviors, experimental findings, workflow designs, and best practices for reproducibility and maintainability. • Collaborate with cybersecurity and governance teams to ensure AI implementations adhere to required policies and safe‑use guidelines. Required Skills & Qualifications: • Ability to iteratively tune, evaluate, and validate AI workflows, including refining prompts, agent configurations, tool‑calling patterns, and retrieval strategies. • Experience designing and running structured tests for AI behavior such as regression tests, scenario‑based evaluations, synthetic testing, and model comparisons. • Skill in diagnosing and correcting AI system failures, including hallucinations, retrieval issues, or tool‑use errors, and implementing guardrails or workflow adjustments. • Documents and maintains AI models, agent behaviors, experiments, and workflow designs. • Proficient in data modeling and familiar with AWS Bedrock services. • Proficiency in Python; familiarity with JavaScript or other languages beneficial. • Comfortable working with CI/CD and Git-based development workflows • Experience integrating observability tools into AI application workflows (logging, metrics, traces). • Years of experience: 5 • Bachelor’s degree required Preferred Skills & Qualifications: • Master’s in Computer Science or related field Benefit Information Our firm offers a professional and respectful work environment, exciting opportunities for professional growth, and comprehensive benefits, including: • Generous paid time off • Health, vision, and dental benefits • Long term/short term disability • Life insurance • 401(k) plan with match available immediately • Employee referral incentive • Remote or Hybrid telework arrangements are available for some positions About Azusa Azusa Solutions (Azusa) helps clients solve their toughest challenges in the area Enterprise Application Development and Maintenance. Azusa is an equal opportunity employer. Find out more about Azusa at www.AzusaSolutions.com.

Requirements

Must-haves

Candidate must hold an active Top Secret Clearance*
Candidate must be local to the DC, Maryland, or Northern Virginia area.*
Design, build, and optimize agentic AI systems using orchestration frameworks like LangGraph, CrewAI, Google ADK, or AWS Bedrock AgentCore, etc.
Implement multi‑step, tool‑enabled AI agentic workflows that combine LLM reasoning, RAG, retrieval systems, external APIs, and custom enterprise tools.
Use leading foundation models (Claude Sonnet, Claude Opus, , etc.) on Amazon Bedrock to build capabilities including structured generation, extraction, summarization, planning, and decision support.
Iteratively tune and refine AI workflows through prompt engineering, instruction design, agent configuration, and tool‑use optimization.
Conduct structured testing and evaluation of AI behavior, including regression tests, scenario‑based evaluations, synthetic test creation, and model‑to‑model comparisons.
Diagnose issues such as hallucinations, retrieval mismatches, tool‑use errors, or unexpected agent behavior, and implement corrective strategies including guardrails and workflow adjustments.
Integrate AI components with vector databases, graph databases, internal applications, and other infrastructure tools—working alongside engineers who manage the underlying systems.
Document model usage patterns, agent behaviors, experimental findings, workflow designs, and best practices for reproducibility and maintainability.
Collaborate with cybersecurity and governance teams to ensure AI implementations adhere to required policies and safe‑use guidelines.
Ability to iteratively tune, evaluate, and validate AI workflows, including refining prompts, agent configurations, tool‑calling patterns, and retrieval strategies.
Experience designing and running structured tests for AI behavior such as regression tests, scenario‑based evaluations, synthetic testing, and model comparisons.
Skill in diagnosing and correcting AI system failures, including hallucinations, retrieval issues, or tool‑use errors, and implementing guardrails or workflow adjustments.
Documents and maintains AI models, agent behaviors, experiments, and workflow designs.
Proficient in data modeling and familiar with AWS Bedrock services.
Proficiency in Python; familiarity with JavaScript or other languages beneficial.
Comfortable working with CI/CD and Git-based development workflows
Experience integrating observability tools into AI application workflows (logging, metrics, traces).
Years of experience: 5
Bachelor’s degree required
Master’s in Computer Science or related field
Benefit Information
Our firm offers a professional and respectful work environment, exciting opportunities for professional growth, and comprehensive benefits, including:

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aiawsllmpythonjavascriptci/cd

Platform: catsone
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Paid Time Off