Software Engineer - AI Infrastructure
Join our dynamic team as a software engineer to support the development and maintenance of AI infrastructure, enabling seamless and efficient use of AI across various applications.
Responsibilities:
• Develop high-quality AI tools and applications for internal workforce usage
• Maintain high availability, reliability, performance, and security of AI solutions
• Modify FOSS to fit customer-specific requirements
• Conduct regular engagements with customers to elicit requirements and develop tailored solutions
• Serve as a technical lead for AI Tools and Applications initiatives
• Provide coaching, feedback, and support to assigned team members
• Navigate ambiguity and define solutions for complex, underspecified systems and requirements
• Establish new technical policies, standards, and governance frameworks where needed
• Drive adoption of new technologies and practices across engineering teams
• Implement monitoring, logging, and observability solutions for AI services
• Communicate effectively with stakeholders at various organizational levels
Required Skills:
• Expertise in UI/UX principles
• Experience using LLMs within code solution workflows
• Able to quickly learn new technologies
• Strong communication skills and willingness to ask questions
• Mastery of Python programming language
• Demonstrated ability to lead a team and manage junior developers
• Significant experience developing and maintaining production software
• Familiarity with AWS or other cloud service providers
• Experience with Kubernetes/Helm
• Familiarity with Argo CD and/or other CI/CD frameworks
• Knowledge of Site Reliability Engineering (SRE) best practices
• Proficiency with Docker and containerization
Nice to Have:
• Experience with LLM UI Open-Source software such as OpenWebUI
• Extensive experience supporting production software using SRE best practices
• Expertise in customer requirements elicitation and community outreach
• Experience with LLM model hosting
Experience Required: 12 years with Bachelor's degree in a technical field, or 16 years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $204,000 - $247,000