Job description

Our Client, an IT Services and Consultant company, is looking for a Sr. Data Engineer – Python / PySpark / Databricks for their Remote location. Responsibilities: • Design, develop, and maintain scalable ETL/ELT pipelines with optimized data processing workflows in Databricks using Python and PySpark. • Integrate data from multiple source systems into enterprise data platforms. • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and to implement data governance, security, and best practices. • Lead and mentor offshore and onshore data engineering teams, ensuring successful project delivery. Requirements: • Seeking for a well experienced Data Engineer with strong expertise in Python, PySpark, and Databricks to design, develop, and optimize scalable data pipelines and data processing solutions. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and modern data engineering practices. • The ideal candidate is a strategic thinker with a developer's mindset, someone who understands the data warehouse and data modelling concepts, can directly solves business problems. • Candidate should have experience in cloud platforms and should have working experience in Spark performance tuning and optimization techniques and need to work in Agile environment. • Years of Experience: 13.00 Years of Experience Why Should You Apply? • Health Benefits • Referral Program • Excellent growth and advancement opportunities

Requirements

Must-haves

Our Client, an IT Services and Consultant company, is looking for a Sr. Data Engineer – Python / PySpark / Databricks for their Remote location.
Design, develop, and maintain scalable ETL/ELT pipelines with optimized data processing workflows in Databricks using Python and PySpark.
Integrate data from multiple source systems into enterprise data platforms.
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and to implement data governance, security, and best practices.
Lead and mentor offshore and onshore data engineering teams, ensuring successful project delivery.
The ideal candidate is a strategic thinker with a developer's mindset, someone who understands the data warehouse and data modelling concepts, can directly solves business problems.
Candidate should have experience in cloud platforms and should have working experience in Spark performance tuning and optimization techniques and need to work in Agile environment.
Years of Experience: 13.00 Years of Experience
Why Should You Apply?
Referral Program
Excellent growth and advancement opportunities

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

pythonagile

Platform: jobdiva
Effort: medium