Mid Data Engineer at Castalia Systems

Job description

Job Type: Full- Time Workplace Type: Hybrid Clearance: Active Secret clearance Must be a U.S. Citizen Job Summary Castalia is seeking exceptional Mid-Level Data Engineers to join our expanding team. In this role, you will be responsible for ensuring data availability—including the seamless movement, modification, and storage of critical data. Working closely with Software Engineers and Data Scientists, you will ensure the scalability and successful deployment of data pipelines that support high-priority users. The Mission Our team develops and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We empower 19 key Principal Staff members (Senior Executive Service and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community. Your work will provide these leaders with the critical, data-driven insights necessary for strategic decision-making. Candidate Profile The ideal candidate is a motivated technologist who thrives with limited direction and is passionate about continuous learning. We are looking for engineers who can pivot quickly to new languages and technologies to solve complex problems. Roles and Responsibilities A qualified candidate will perform the following duties and responsibilities, but are not limited to: • Develop, maintain, and enhance data pipelines and ETL processes to ingest, transform, integrate, and deliver mission-critical data from multiple sources. • Support data availability, quality, reliability, and performance by monitoring data workflows, troubleshooting issues, and assisting with optimization of data processing and storage solutions. • Build and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data engineering technologies . • Collaborate with Software Engineers, Data Scientists, and mission stakeholders to integrate data and support the development and deployment of AI/ML applications and data-driven analytics . • Support secure data integration, data cleaning, organization, and transfer processes , while following established database design, cybersecurity, and data management best practices. Required Qualifications • BS Degree. • 3+ years of professional experience needed for MOST of our opportunities. • Python experience with data manipulation, scripting, and more. • Databricks experience. • Proficient in designing and implementing Extract Transform Load (ETL) data processes. • Experience with at least ONE relational database, such as PostgreSQL, MySQL or SQLite. • Experience with Agile SCRUM methodologies. Preferred Qualifications • Familiar with database design, server management, connection protocols, database normalization, and principles of information theory. • Experience with data cleaning or data organization. • Familiar with NiFi, SQL, NoSQL and Graph Databases and Data Lakes. • Familiar with Dashboarding tools similar to Qlik. • Familiar with Cybersecurity with design and implementation of unique data transfer protocols. Physical Requirements/Work Environment • ONSITE 3-5 days per week. • Normal office environment. Travel • As needed Company Description Castalia Systems is a proven business partner providing mission critical solutions to the Federal Government. We provide cutting edge solutions from Securing and Managing Data to Systems Engineering and Development. Castalia Systems is a pioneer in Artificial Intelligence Design and Application. With our vast knowledge of our customers’ needs and relevant technology, our team is able to bring successful solutions to every mission. We are one-upping our competitors by providing premium IT solutions and platforms with cutting-edge technology so it’s so evident when you compare us with anyone. Compensation At Castalia Systems, we provide you with opportunities and choices and support your total well-being. Our benefits include: Medical, dental, vision coverage, 401k matching, generous PTO, paid holidays, professional training opportunities, and even pet insurance to ensure your furry friends are cared for too. All regularly scheduled employees working at least 30 hours per week are eligible to participate in Castalia Systems’ benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. Salary at Castalia Systems is determined by various factors, including but not limited to location, position knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $135,000.00 to $140,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Castalia Systems’ total compensation package for employees. Disclaimer Castalia Systems is an equal employment opportunity and affirmative action employer and strives to comply with all applicable laws prohibiting discrimination based on race, color, creed, sex, sexual orientation, age, national origin, or ancestry, physical or mental disability, veteran status, marital status, HIV-positive status, as well as any other category protected by federal, state, or local laws. All such discrimination is unlawful, and all persons involved in the operations of the company are prohibited from engaging in this type of conduct.

Requirements

Must-haves

Job Type: Full- Time
Workplace Type: Hybrid
Clearance: Active Secret clearance
Must be a U.S. Citizen
Candidate Profile
Roles and Responsibilities
A qualified candidate will perform the following duties and responsibilities, but are not limited to:
Develop, maintain, and enhance data pipelines and ETL processes to ingest, transform, integrate, and deliver mission-critical data from multiple sources.
Support data availability, quality, reliability, and performance by monitoring data workflows, troubleshooting issues, and assisting with optimization of data processing and storage solutions.
Build and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data engineering technologies .
Collaborate with Software Engineers, Data Scientists, and mission stakeholders to integrate data and support the development and deployment of AI/ML applications and data-driven analytics .
Support secure data integration, data cleaning, organization, and transfer processes , while following established database design, cybersecurity, and data management best practices.
3+ years of professional experience needed for MOST of our opportunities.
Python experience with data manipulation, scripting, and more.
Databricks experience.

Nice-to-haves

Familiar with database design, server management, connection protocols, database normalization, and principles of information theory.
Experience with data cleaning or data organization.
Familiar with NiFi, SQL, NoSQL and Graph Databases and Data Lakes.
Familiar with Dashboarding tools similar to Qlik.
Familiar with Cybersecurity with design and implementation of unique data transfer protocols.
Physical Requirements/Work Environment
ONSITE 3-5 days per week.
Normal office environment.
Company Description

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimachine learningpythonsqlmlagilescrum

Platform: clearcompany
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401k

Pto