Job description

Role: Senior Data Engineer (Databricks) Location: NYC, NY (or), Seattle, WA (or), Irvine, CA (or), Los Angeles, CA (Hybrid) Project description We are seeking a seasoned professional whose role sits at the intersection of platform engineering, data engineering, and data product development. You will build reusable platform capabilities and data products that let quantitative researchers Client, access, and consume data across a complex, disparate landscape, and then accelerate the good prototypes to production. This is a contractor position. Responsibilities • Design, build, and enhance platform capabilities within Databricks and related technologies. • Build reusable data products and self-service capabilities. • Design and maintain data pipelines and integration frameworks. • Improve data quality, reliability, lineage, and monitoring. • Accelerate research-to-production delivery: prototype solutions alongside researchers; establish patterns that make productionization easier and faster; reduce friction between research and engineering workflows. Skills Must have • 10+ years of platform and data solutions experience • Hands-on Databricks experience (workspace, notebooks, jobs) and building platform capabilities • Python • SQL • Modern CI/CD, IaC (Terraform strongly preferred) • Data Governance and observability (Unity Catalog, lineage, monitoring) • Orchestration (Airflow) • AI fluency: use of AI agents (Claude Code preferred) as a primary tool to design, build, test, and support solutions Nice to have • Financial domain experience, especially quant research • API development • PowerBI

Requirements

Must-haves

Role: Senior Data Engineer (Databricks)
Location: NYC, NY (or), Seattle, WA (or), Irvine, CA (or), Los Angeles, CA (Hybrid)
Project description
This is a contractor position.
Design, build, and enhance platform capabilities within Databricks and related technologies.
Build reusable data products and self-service capabilities.
Design and maintain data pipelines and integration frameworks.
Improve data quality, reliability, lineage, and monitoring.
Accelerate research-to-production delivery: prototype solutions alongside researchers; establish patterns that make productionization easier and faster; reduce friction between research and engineering workflows.
10+ years of platform and data solutions experience
Hands-on Databricks experience (workspace, notebooks, jobs) and building platform capabilities
Data Governance and observability (Unity Catalog, lineage, monitoring)
Orchestration (Airflow)

Nice-to-haves

Modern CI/CD, IaC (Terraform strongly preferred)
AI fluency: use of AI agents (Claude Code preferred) as a primary tool to design, build, test, and support solutions
Financial domain experience, especially quant research
API development

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

pythonsqlci/cdaiapi

Platform: jobdiva
Effort: medium