Job description

Position Objective: The Data Engineer will play a critical role within the organization, helping to manage and transform complex data ecosystems to provide scalable, analysis-ready solutions that inform senior leadership decisions. You will be at the technical forefront of data pipeline development, data architecture, and infrastructure optimization, ensuring that the organization’s analytical operations rest on a robust and secure foundation. This is a role for a highly technical and driven individual capable of building enterprise-level data management systems that support current and future data science initiatives. Your expertise will enable critical insights, informing strategies, optimizing data processes, and facilitating efficient decision-making. You will work alongside a team of data scientists, operational leaders, and infrastructure architects to maintain the integrity, scalability, and performance of critical data systems within the organization. Duties and Responsibilities: • Design, implement, and maintain enterprise grade ETL/ELT pipelines using Python and SQL • Build, optimize, and manage data models, warehouses, and lakehouse environments (e.g., Databricks) • Develop processes for ingesting, cleaning, validating, and transforming large scale datasets from APIs, relational sources, and unstructured systems • Implement data quality, metadata management, and governance controls to ensure consistency and trust in analytics workflows • Collaborate with cloud engineering teams to deploy and manage data solutions on Azure • Monitor, troubleshoot, and improve pipeline performance using logging, alerting, and CI/CD practices • Document data architecture, pipeline logic, and operational procedures to enable team collaboration and maintainability Basic Qualifications: • 8+ years of experience in data engineering, software engineering, or database architecture • 6+ years of experience in Python and SQL with experience building scalable ETL/ELT pipelines • 2+ years of experience with cloud data ecosystems like Azure Data Factory • 1+ years of experience with modern data processing frameworks like Databricks • Experience with integrating and transforming data from diverse formats and systems (APIs, flat files, relational sources) • Knowledge of relational and NoSQL databases, data modeling, and schema design • Knowledge of data governance, security, and compliance principles for enterprise data environments • Bachelor’s degree in computer science, Engineering, Information Systems, or a related, quantitative field • Ability to support on-site work in Atlanta, GA or Washington, DC • Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder) Preferred Qualifications: • Experience with supporting key data engineering efforts in a government related environment • Experience with collaborating with data scientists and analysts to define data models that meet evolving organizational goals • Knowledge of IT infrastructure practices and data access methodologies • Knowledge of advanced data security practices, governance policies, and compliance frameworks • Certifications such as Azure Data Engineer Associate *This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required by this position. To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. GAP Solutions provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job, email us at recruiting@gapsi.com . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law.

Requirements

Must-haves

Design, implement, and maintain enterprise grade ETL/ELT pipelines using Python and SQL
Build, optimize, and manage data models, warehouses, and lakehouse environments (e.g., Databricks)
Develop processes for ingesting, cleaning, validating, and transforming large scale datasets from APIs, relational sources, and unstructured systems
Implement data quality, metadata management, and governance controls to ensure consistency and trust in analytics workflows
Collaborate with cloud engineering teams to deploy and manage data solutions on Azure
Monitor, troubleshoot, and improve pipeline performance using logging, alerting, and CI/CD practices
Document data architecture, pipeline logic, and operational procedures to enable team collaboration and maintainability
8+ years of experience in data engineering, software engineering, or database architecture
6+ years of experience in Python and SQL with experience building scalable ETL/ELT pipelines
2+ years of experience with cloud data ecosystems like Azure Data Factory
1+ years of experience with modern data processing frameworks like Databricks
Experience with integrating and transforming data from diverse formats and systems (APIs, flat files, relational sources)
Knowledge of relational and NoSQL databases, data modeling, and schema design
Knowledge of data governance, security, and compliance principles for enterprise data environments
Bachelor’s degree in computer science, Engineering, Information Systems, or a related, quantitative field
Ability to support on-site work in Atlanta, GA or Washington, DC
Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder)
This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required by this position.

Nice-to-haves

Experience with supporting key data engineering efforts in a government related environment
Experience with collaborating with data scientists and analysts to define data models that meet evolving organizational goals
Knowledge of IT infrastructure practices and data access methodologies
Knowledge of advanced data security practices, governance policies, and compliance frameworks
Certifications such as Azure Data Engineer Associate
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

restpythonsqlazureci/cd

Platform: paycom
Effort: medium