Job description

• Design, develop, maintain, and support Python-based ETL pipelines and data integration solutions . • Develop and maintain REST APIs for data ingestion and system integration. • Extract data from databases, APIs, flat files, cloud platforms, and other sources. • Transform, cleanse, validate, and prepare data based on business requirements. • Load data into data warehouses, operational databases, and reporting systems. • Implement data validation, quality checks, error handling, logging, and performance optimization. • Schedule and automate ETL workflows and monitor production processes. • Troubleshoot ETL issues and optimize pipeline performance and reliability. • Collaborate with business stakeholders, analysts, and development teams to deliver data solutions. • Create technical documentation and support production deployments. Required Qualifications • 8+ years of experience in ETL development, data integration, and data engineering. • Strong hands-on experience with Python for ETL development and automation. • Extensive experience designing, developing, and maintaining ETL pipelines. • Proven experience building and consuming REST APIs for data integration. • Strong SQL skills with experience in Oracle, SQL Server, PostgreSQL, MySQL, or similar databases. • Experience working with JSON, XML, CSV , and other structured/unstructured data formats. • Experience with data validation, data quality, error handling, logging, and performance optimization. • Experience scheduling and automating ETL workflows. Preferred Qualifications • Experience with Apache Airflow, SSIS, Informatica, Talend , or similar ETL tools. • Experience with AWS, Azure, or GCP cloud platforms. • Knowledge of data warehousing and dimensional modeling concepts. • Experience with Git, CI/CD pipelines, and Agile methodologies .

Requirements

Must-haves

Design, develop, maintain, and support Python-based ETL pipelines and data integration solutions .
Develop and maintain REST APIs for data ingestion and system integration.
Extract data from databases, APIs, flat files, cloud platforms, and other sources.
Transform, cleanse, validate, and prepare data based on business requirements.
Load data into data warehouses, operational databases, and reporting systems.
Implement data validation, quality checks, error handling, logging, and performance optimization.
Schedule and automate ETL workflows and monitor production processes.
Troubleshoot ETL issues and optimize pipeline performance and reliability.
Collaborate with business stakeholders, analysts, and development teams to deliver data solutions.
Create technical documentation and support production deployments.
8+ years of experience in ETL development, data integration, and data engineering.
Strong hands-on experience with Python for ETL development and automation.
Extensive experience designing, developing, and maintaining ETL pipelines.
Proven experience building and consuming REST APIs for data integration.
Strong SQL skills with experience in Oracle, SQL Server, PostgreSQL, MySQL, or similar databases.
Experience working with JSON, XML, CSV , and other structured/unstructured data formats.
Experience with data validation, data quality, error handling, logging, and performance optimization.
Experience scheduling and automating ETL workflows.

Nice-to-haves

Experience with Apache Airflow, SSIS, Informatica, Talend , or similar ETL tools.
Experience with AWS, Azure, or GCP cloud platforms.
Knowledge of data warehousing and dimensional modeling concepts.
Experience with Git, CI/CD pipelines, and Agile methodologies .

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

pythonrestsqlawsazuregcpci/cdagile

Platform: careers-page
Effort: medium