Job description

Senior Software Engineer We’re seeking a senior software engineer to support our AI infrastructure team in Columbia, MD. In this role, you’ll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications. Responsibilities: • Lead the evaluation, configuration, and deployment of inference models for our users. • Mentor engineers and grow development best practices and standards for the team. • Engage with other teams to establish solid infrastructure for services and integrate LLM-powered tools for user needs. • Collaborate on surge efforts to support short-term, high-priority inference needs from our customer. Required Skills: • Experience with Python and/or other modern programming languages. • Experience with Argo CD and/or other CI/CD frameworks. • Experience with Kubernetes/Helm. • Experience with AWS or other cloud service providers. • Strong communication skills and ability to mentor other engineers. • Excellent leadership and stakeholder management skills. Nice to Have: • Experience with vLLM, LiteLLM, or similar inference-serving frameworks. • Experience with Docker and containerization. • Knowledge of hosting AI capabilities. Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000

Requirements

Must-haves

Senior Software Engineer
Lead the evaluation, configuration, and deployment of inference models for our users.
Mentor engineers and grow development best practices and standards for the team.
Engage with other teams to establish solid infrastructure for services and integrate LLM-powered tools for user needs.
Collaborate on surge efforts to support short-term, high-priority inference needs from our customer.
Experience with Python and/or other modern programming languages.
Experience with Argo CD and/or other CI/CD frameworks.
Experience with Kubernetes/Helm.
Experience with AWS or other cloud service providers.
Strong communication skills and ability to mentor other engineers.
Excellent leadership and stakeholder management skills.
Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree
Clearance: TS/SCI with Polygraph required

Nice-to-haves

Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
Experience with Docker and containerization.
Knowledge of hosting AI capabilities.
Location: Columbia, MD

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aillmpythonci/cdkubernetesawsdocker

Platform: neural-solutions
Effort: medium