Job description

GENERAL DESCRIPTION OF POSITION The Data Engineer is responsible for development and support of data products on a modern cloud-based data lake, leveraging expertise and knowledge of multiple technologies & data domains to help build a robust, scalable, and reliable data engineering platform. Additionally, a Data Engineer is responsible for providing data services for enterprise-grade analytical environments, utilizing automated data pipelines at scale, and streamlining efficient data transformations for priority use cases . This role can be involved hands on in development of the codebase and partners with business units and peer technology groups to support analytics execution. ESSENTIAL DUTIES AND RESPONSIBILITIES • Partner across the organization to architect, implement, deploy, and maintain data-driven systems solutions • Build, maintain and simplify enterprise data pipelines with emphasis on security, reusability & data quality. • Perform debugging and fixing application issues, root cause analysis, and help in proactive/preventive maintenance. Help in technical debt reduction and follow clean code principles • Development experience in one or more languages (e.g. Python, SQL, PySpark) • Experience in the use of Infrastructure as Code tools (Databricks Asset Bundled,Terraform) • Engagement in data governance council to define, develop, and review standards, guidelines, and data models to promote data quality and best practices • Leverage DevOps tools to automate deployment and validation/test automation of data engineering pipelines. • Writes and executes complete testing plans, protocols, and documentation for assigned portion of data system or component; identifies defects and creates solutions for issues with code and integration into data system architecture. • Effectively plan and collaborate with technical and non-technical teams on business initiatives QUALIFICATIONS To perform this job successfully, an individual must be able to perform each essential duty mentioned satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required: • • Technical knowledge of BI systems design • Big data architecture and technology landscape • ETL orchestrations • Strong communications skills • Comfort working in a fast-paced, multi-task environment EDUCATION AND EXPERIENCE Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or an equivalent combination of education and relevant experience. Demonstrated understanding of core technology disciplines, including but not limited to software development, database administration, systems architecture, cloud technologies, infrastructure, and related technical domains. 1-2 years of relevant experience in data engineering, data analytics, software development, database administration, or a related technical field.

Requirements

Must-haves

Partner across the organization to architect, implement, deploy, and maintain data-driven systems solutions
Build, maintain and simplify enterprise data pipelines with emphasis on security, reusability & data quality.
Perform debugging and fixing application issues, root cause analysis, and help in proactive/preventive maintenance. Help in technical debt reduction and follow clean code principles
Development experience in one or more languages (e.g. Python, SQL, PySpark)
Experience in the use of Infrastructure as Code tools (Databricks Asset Bundled,Terraform)
Engagement in data governance council to define, develop, and review standards, guidelines, and data models to promote data quality and best practices
Leverage DevOps tools to automate deployment and validation/test automation of data engineering pipelines.
Effectively plan and collaborate with technical and non-technical teams on business initiatives
To perform this job successfully, an individual must be able to perform each essential duty mentioned satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required:
Technical knowledge of BI systems design
Big data architecture and technology landscape
ETL orchestrations
Strong communications skills
Comfort working in a fast-paced, multi-task environment
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or an equivalent combination of education and relevant experience.
1-2 years of relevant experience in data engineering, data analytics, software development, database administration, or a related technical field.

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

pythonsql

Platform: adp-recruiting
Effort: medium