Job description

Software Engineer We are seeking a software engineer to support our AI infrastructure team at Neural Solutions. You will help build and maintain the foundation for advanced AI capabilities, ensuring high-quality language model (LLM) access throughout the inference software stack. Responsibilities: • Procure, configure, and test new inference models, preparing them for release to our user base. • Develop in-house services and techniques to ensure continuous high-quality inference service. • Collaborate with model vendor teams to create reliable pipelines for closed-source model usage. • Support surge efforts to meet short-term, high-priority inference needs from our customer. • Engage with other teams to establish robust infrastructure and integrate LLM-powered tools. Required Skills: • Experience with Python or other modern programming languages. • Familiarity with Argo CD or other CI/CD frameworks. • Experience with Kubernetes/Helm. • Familiarity with AWS or other cloud service providers. • Ability to learn new technologies quickly. • Strong communication skills and willingness to ask questions. Nice to Have: • Experience with vLLM, LiteLLM, or similar inference-serving frameworks. • Experience with other LLM hosting frameworks and practices. • Experience supporting production software using Site Reliability Engineering (SRE) best practices. • Familiarity with Elastic, Grafana/Prometheus, or other observability frameworks. • Experience with Docker and containerization. • Experience in traffic shaping and quality-of-service engineering. Experience Required: 3 years with Bachelor’s degree in a technical field, or 7 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $138,000 - $163,000

Requirements

Must-haves

Software Engineer
Procure, configure, and test new inference models, preparing them for release to our user base.
Develop in-house services and techniques to ensure continuous high-quality inference service.
Collaborate with model vendor teams to create reliable pipelines for closed-source model usage.
Support surge efforts to meet short-term, high-priority inference needs from our customer.
Engage with other teams to establish robust infrastructure and integrate LLM-powered tools.
Experience with Python or other modern programming languages.
Familiarity with Argo CD or other CI/CD frameworks.
Experience with Kubernetes/Helm.
Familiarity with AWS or other cloud service providers.
Ability to learn new technologies quickly.
Strong communication skills and willingness to ask questions.
Experience Required: 3 years with Bachelor’s degree in a technical field, or 7 years without degree
Clearance: TS/SCI with Polygraph required

Nice-to-haves

Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
Experience with other LLM hosting frameworks and practices.
Experience supporting production software using Site Reliability Engineering (SRE) best practices.
Familiarity with Elastic, Grafana/Prometheus, or other observability frameworks.
Experience with Docker and containerization.
Experience in traffic shaping and quality-of-service engineering.
Location: Columbia, MD

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aillmpythonci/cdkubernetesawsdocker

Platform: neural-solutions
Effort: medium