Job description

Our Client, an IT Services and Consultant company, is looking for an Azure Databricks Data Engineer for their Fort Worth, TX / Tempe, AZ / Hybrid location. Responsibilities: • Design, develop, and maintain scalable data pipelines using Azure Databricks and Python. • Build and optimize ETL/ELT workflows for structured and unstructured data. • Develop high-performance data processing solutions using Py Spark and Spark SQL. • Design and implement data lake architecture leveraging Delta Lake. • Create and manage data ingestion frameworks from multiple enterprise sources. • Implement data quality, validation, governance, and monitoring mechanisms. • Must have hands on experience using Gen AI tools like GitHub CoPilot • Optimize Databricks jobs, clusters, notebooks, and workflows for performance and cost efficiency. • Collaborate with business analysts, data scientists, architects, and application teams to deliver enterprise data solutions. • Support batch and near real-time data processing requirements. • Participate in architecture discussions, code reviews, and best-practice implementation. • Ensure secure, scalable, and reliable cloud data solutions aligned with organizational standards. Requirements: • Primary Skills (Must Have): • Azure Databricks • Python • Py Spark • Delta Lake • Spark SQL • Data Engineering • ETL/ELT Development • Azure Data Lake Storage (ADLS Gen2) • SQL • Azure Platform Skills • Azure Databricks • Azure Data Factory (ADF) • Azure Storage Accounts • Azure Key Vault • Azure Monitor • Azure App Insights • Azure Networking Concepts • Secondary Skills: • Data Modeling (Star Schema, Snowflake Schema) • DataWarehousing Concepts • Performance Tuning and Optimization • REST API Integration • NoSQL Databases • Azure Synapse Analytics • Years of Experience: • 7-9 Years of Experience Why Should You Apply? • Health Benefits • Referral Program • Excellent growth and advancement opportunities

Requirements

Must-haves

Our Client, an IT Services and Consultant company, is looking for an Azure Databricks Data Engineer for their Fort Worth, TX / Tempe, AZ / Hybrid location.
Design, develop, and maintain scalable data pipelines using Azure Databricks and Python.
Build and optimize ETL/ELT workflows for structured and unstructured data.
Develop high-performance data processing solutions using Py Spark and Spark SQL.
Design and implement data lake architecture leveraging Delta Lake.
Create and manage data ingestion frameworks from multiple enterprise sources.
Implement data quality, validation, governance, and monitoring mechanisms.
Must have hands on experience using Gen AI tools like GitHub CoPilot
Optimize Databricks jobs, clusters, notebooks, and workflows for performance and cost efficiency.
Collaborate with business analysts, data scientists, architects, and application teams to deliver enterprise data solutions.
Support batch and near real-time data processing requirements.
Participate in architecture discussions, code reviews, and best-practice implementation.
Ensure secure, scalable, and reliable cloud data solutions aligned with organizational standards.
Azure Databricks
Data Engineering
ETL/ELT Development
Azure Data Lake Storage (ADLS Gen2)
Azure Platform Skills
Azure Databricks
Azure Data Factory (ADF)
Azure Storage Accounts
Azure Key Vault
Azure Monitor
Azure App Insights

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

azurepythonsqlairestapi

Platform: jobdiva
Effort: medium