Job description

Sr. Databricks Data Engineer Remote Blu Omega is seeking a Sr Databricks Data Engineer to support the CDC/NCIRD enterprise data and design support program. This role is responsible for designing, building, and optimizing scalable data pipelines and cloud-based data solutions supporting mission-critical federal programs. Program Overview Blu Omega supports the CDC’s mission to protect public health through data-driven decisions and solutions. Key Details Location: Remote Clearance / Suitability: Public Trust eligibility required Responsibilities • Design, develop, and maintain scalable ETL/ELT workflows using Databricks, Python, PySpark, Spark SQL, and SQL. • Build and optimize enterprise data solutions across Azure Data Lake Storage, Azure Data Factory, Databricks, and related Azure services. • Transform, integrate, and organize structured and unstructured data from multiple sources into reliable, analytics-ready datasets. • Design and optimize Delta Lake architectures, Delta Tables, and data models supporting high-performance analytics and machine learning workloads. • Develop and maintain data lake and database solutions across SQL and NoSQL technologies. • Implement data quality controls, testing, monitoring, and post-deployment validation throughout the data pipeline lifecycle. • Automate data pipeline operations and Databricks workflows to improve reliability, scalability, and operational efficiency. • Collaborate with data engineers, developers, analysts, and stakeholders within Agile teams to translate data requirements into scalable technical solutions. Required Qualifications • 8+ years of experience designing, developing, and maintaining scalable ETL/ELT workflows supporting analytics or machine learning workloads. • 3+ years of hands-on Databricks experience, including Lakeflow Jobs, Databricks Workflows, Unity Catalog, Delta Lake, Delta Tables, or Delta Sharing. • 3+ years of data engineering experience using Python, PySpark, Spark SQL, and/or SQL. • 3+ years of experience working with database technologies such as SQL Server, PostgreSQL, MySQL, MongoDB, or similar platforms. • 3+ years of experience applying data modeling techniques, including dimensional modeling and schemas optimized for Delta Lake and analytical query performance. • Hands-on experience with Azure Data Lake Storage, Azure Data Factory, and related Azure data services. • Experience with NoSQL concepts and platforms such as Cosmos DB, Elasticsearch, or similar technologies. • Experience transforming heterogeneous raw data into standardized datasets and automating pipeline operations. • Ability to obtain and maintain a Public Trust clearance. • Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder). Compensation Salary Range: $150,000.00 - $165,000.00 Final compensation is based on technical skills, experience, education, certifications, and clearance. Benefits & Perks • Medical, Dental, and Vision coverage through national providers • 401(k) with company match (eligible after 6 months; vesting applies) • Company-paid Life and AD&D insurance with additional voluntary options • Short-term disability (company-paid) and long-term disability options • Employee Assistance Program (EAP) with 24/7 confidential support and mental health resources • Telehealth and virtual care options available through medical plans • Pet insurance, legal services, and identity theft protection options • Paid Time Off (PTO) for eligible employees • Paid federal holidays for salaried employees • Access to wellness programs, discounts, and lifestyle benefits Company Overview Blu Omega is a Woman-Owned Small Business (WOSB) providing technology and cybersecurity solutions to federal agencies and enterprise clients nationwide. Headquartered in Ashburn, VA, we support mission-critical programs across civilian and defense sectors, including health, national security, and regulatory environments. We partner with government agencies and large integrators to deliver expertise in cybersecurity operations, cloud and infrastructure modernization, data and analytics, and enterprise IT support. Equal Opportunity Employer All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability. #CJ #LI-Remote

Requirements

Must-haves

Sr. Databricks Data Engineer
Program Overview
Blu Omega supports the CDC’s mission to protect public health through data-driven decisions and solutions.
Location: Remote
Clearance / Suitability: Public Trust eligibility required
Design, develop, and maintain scalable ETL/ELT workflows using Databricks, Python, PySpark, Spark SQL, and SQL.
Build and optimize enterprise data solutions across Azure Data Lake Storage, Azure Data Factory, Databricks, and related Azure services.
Transform, integrate, and organize structured and unstructured data from multiple sources into reliable, analytics-ready datasets.
Design and optimize Delta Lake architectures, Delta Tables, and data models supporting high-performance analytics and machine learning workloads.
Develop and maintain data lake and database solutions across SQL and NoSQL technologies.
Implement data quality controls, testing, monitoring, and post-deployment validation throughout the data pipeline lifecycle.
Automate data pipeline operations and Databricks workflows to improve reliability, scalability, and operational efficiency.
Collaborate with data engineers, developers, analysts, and stakeholders within Agile teams to translate data requirements into scalable technical solutions.
8+ years of experience designing, developing, and maintaining scalable ETL/ELT workflows supporting analytics or machine learning workloads.
3+ years of hands-on Databricks experience, including Lakeflow Jobs, Databricks Workflows, Unity Catalog, Delta Lake, Delta Tables, or Delta Sharing.
3+ years of data engineering experience using Python, PySpark, Spark SQL, and/or SQL.
3+ years of experience working with database technologies such as SQL Server, PostgreSQL, MySQL, MongoDB, or similar platforms.
3+ years of experience applying data modeling techniques, including dimensional modeling and schemas optimized for Delta Lake and analytical query performance.
Hands-on experience with Azure Data Lake Storage, Azure Data Factory, and related Azure data services.
Experience with NoSQL concepts and platforms such as Cosmos DB, Elasticsearch, or similar technologies.
Experience transforming heterogeneous raw data into standardized datasets and automating pipeline operations.
Ability to obtain and maintain a Public Trust clearance.
Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder).

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

pythonsqlazuremachine learningagile

Platform: bullhorn
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Pto

Paid Time Off

Wellness