Job description

Job Title: Data Engineer - AI Platform Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC Number of openings: 1 Experience: 5+ years of professional experience as a data engineer Salary: $165,000 - $175,000 Clearance: Secret (prefer TS) Position Summary We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures. You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments. Key Responsibilities • Design and build robust data ingestion and processing pipelines to support AI and GenAI applications • Develop and maintain high-quality Python-based data workflows , including testing and validation • Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers • Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes • Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial) • Utilize containerization technologies (Docker) to support scalable and portable deployments • Contribute to the development and optimization of data systems used by generative AI applications • Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics What You'll Experience • Opportunity to work on high-impact AI platform initiatives • A fast-paced, performance-driven environment with strong technical mentorship • Continuous learning through structured development programs and real-world problem solving • A collaborative culture that values innovation, ownership, and diverse perspectives • Exposure to globally distributed teams and modern engineering practices • Competitive compensation along with a comprehensive benefits package Required Qualifications • U.S. Citizenship is required • Prior experience supporting defense or government environments , including handling classified or sensitive data • Active Secret clearance required (Top Secret or higher preferred) • 5+ years of experience in data engineering, with a strong focus on cloud-based solutions Technical Skills & Expertise • Strong proficiency in Python for data engineering and pipeline development • Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus) • Deep understanding of data modeling , data ingestion frameworks , and pipeline architecture • Experience working with knowledge graphs , particularly using Neo4j , and familiarity with relational databases • Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices • Practical experience with Docker and containerized workflows • Strong background in data pipeline performance tuning, monitoring, and troubleshooting • Excellent analytical and problem-solving capabilities • Effective communication skills and ability to collaborate within cross-functional teams

Requirements

Must-haves

Job Title: Data Engineer - AI Platform
Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC
Number of openings: 1
Experience: 5+ years of professional experience as a data engineer
Salary: $165,000 - $175,000
Clearance: Secret (prefer TS)
Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
Develop and maintain high-quality Python-based data workflows , including testing and validation
Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
Utilize containerization technologies (Docker) to support scalable and portable deployments
Contribute to the development and optimization of data systems used by generative AI applications
Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
Opportunity to work on high-impact AI platform initiatives
A fast-paced, performance-driven environment with strong technical mentorship
Continuous learning through structured development programs and real-world problem solving
A collaborative culture that values innovation, ownership, and diverse perspectives
Exposure to globally distributed teams and modern engineering practices
Competitive compensation along with a comprehensive benefits package
U.S. Citizenship is required

Nice-to-haves

Active Secret clearance required (Top Secret or higher preferred)
Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aipythonci/cdawsazuregcpdocker

Platform: manatal
Effort: medium