Job description

About the Role As Apartment List's data platform grows across more domains, more pipelines, and more stakeholders, the architectural decisions made today determine how much technical debt we're paying down in a year. We're looking for a Senior Data Engineer II (IC4) to own that architecture; end-to-end pipeline design, platform investment tradeoffs, and the technical judgment calls that keep the system reliable as it scales. This is not a design-from-the-whiteboard role. You'll still be hands-on-keyboard: writing pipelines, debugging production issues, and shipping code alongside the team. What sets this role apart is scope; you'll make architectural decisions independently, influence how Analytics Engineering, Data Science, and Engineering partners build on the platform, and be the person other data engineers come to when a design decision needs a second opinion. You'll work closely with Analytics Engineering, Data Science, and Engineering partners to shape how the data platform evolves. Here's what you'll do as part of the team • Own and evolve data pipeline architecture across core domains — ingestion, transformation, modeling, and serving — making project-level architectural decisions independently and evaluating tradeoffs between freshness, cost, scalability, and simplicity. • Lead the design and implementation of platform-level improvements: warehouse cost management, compute efficiency, and access control architecture, treating reliability, observability, and cost efficiency as core design constraints rather than afterthoughts. • Identify and lead technical initiatives that improve the platform's long-term health — proactively surfacing investments (orchestration, CI/CD, data access, developer experience) before they become blockers, and making the case for them. • Drive large, technically complex projects or multiple concurrent medium-sized initiatives that span teams, taking responsibility for outcomes rather than just execution. • Lead monitoring and testing strategy for your domain: proactively close observability gaps across the org, build alerting ahead of failures, and serve as the go-to engineer for the hardest production issues. • Influence technical decisions and architectural direction beyond the Data & Analytics team, partnering directly with EPD stakeholders on infrastructure decisions that affect their roadmaps. • Actively mentor other data engineers and analytics engineers, reviewing architectural and modeling decisions, and operate as a technical peer to senior engineers across teams. • Integrate AI meaningfully into data engineering workflows — building tooling and automation that creates leverage for the whole team, not just individual output, and coaching others on effective, validated use. Here are the skills and experience you'll need to be successful Must-haves: • 7+ years of data engineering experience, including a demonstrated track record of owning end-to-end pipeline architecture, not just implementing to spec. • Deep experience designing orchestration workflows in Apache Airflow, including making architectural tradeoffs across ingestion, transformation, modeling, and serving layers. • Experience working with containerized data infrastructure in production, including deploying services, diagnosing operational issues, and contributing to platform reliability and scalability. • Demonstrated ability to evaluate and communicate architectural tradeoffs (freshness vs. cost, scalability vs. simplicity) to both technical and non-technical stakeholders. • Experience building or significantly improving CI/CD practices for data pipelines, including automated testing, validation, and deployment. • A track record of leading incident response and monitoring strategy for a domain, including building alerting and observability ahead of failures rather than reacting to them. • Experience influencing technical decisions across multiple teams or functions, including partnering with engineering, product, or data science stakeholders outside your immediate team. • Experience mentoring other data engineers, including reviewing architectural and modeling decisions. Nice-to-haves: • Experience with Kubernetes-based data infrastructure • Experience leading a legacy ETL-to-modern-orchestration migration end-to-end, not just contributing to one. • Familiarity with observability and monitoring tooling such as Datadog at a platform-wide scale. • Experience building internal tooling or automation (including AI-assisted) that other engineers rely on. Here's the Pay Range: At Apartment List, we carefully consider a variety of factors to determine compensation for each position, including the role, level, and work. The US Total Target Compensation (TTC) for this position is: • Zone 1: $210,000 - $255,000 TTC (including $189,000 - $229,000 base salary) + equity • Zone 2: $194,000 - $236,000 TTC (including $175,000 - $212,000 base salary) + equity • Zone 3: $179,000 - $217,000 TTC (including $161,000 - $195,000 base salary) + equity This reflects the compensation target for new hire salaries for the position across all US locations. Please note, the compensation details provided do not include benefits and perks that we offer. We also rely on market indicators along with considering your work location, job related skills, experience and relevant education and training, to determine compensation that is fair and competitive for you. Apartment List will consider paying compensation near the higher of the range in exceptional circumstances, where candidates have the experience, credentials or expertise that would warrant such consideration. It is always our goal to hire exceptional talent and we would be happy to share more about compensation during the hiring process.

Requirements

Must-haves

Here's what you'll do as part of the team
Drive large, technically complex projects or multiple concurrent medium-sized initiatives that span teams, taking responsibility for outcomes rather than just execution.
Lead monitoring and testing strategy for your domain: proactively close observability gaps across the org, build alerting ahead of failures, and serve as the go-to engineer for the hardest production issues.
Influence technical decisions and architectural direction beyond the Data & Analytics team, partnering directly with EPD stakeholders on infrastructure decisions that affect their roadmaps.
Actively mentor other data engineers and analytics engineers, reviewing architectural and modeling decisions, and operate as a technical peer to senior engineers across teams.
Integrate AI meaningfully into data engineering workflows — building tooling and automation that creates leverage for the whole team, not just individual output, and coaching others on effective, validated use.
Here are the skills and experience you'll need to be successful
7+ years of data engineering experience, including a demonstrated track record of owning end-to-end pipeline architecture, not just implementing to spec.
Deep experience designing orchestration workflows in Apache Airflow, including making architectural tradeoffs across ingestion, transformation, modeling, and serving layers.
Experience working with containerized data infrastructure in production, including deploying services, diagnosing operational issues, and contributing to platform reliability and scalability.
Demonstrated ability to evaluate and communicate architectural tradeoffs (freshness vs. cost, scalability vs. simplicity) to both technical and non-technical stakeholders.
Experience building or significantly improving CI/CD practices for data pipelines, including automated testing, validation, and deployment.
A track record of leading incident response and monitoring strategy for a domain, including building alerting and observability ahead of failures rather than reacting to them.
Experience influencing technical decisions across multiple teams or functions, including partnering with engineering, product, or data science stakeholders outside your immediate team.
Experience mentoring other data engineers, including reviewing architectural and modeling decisions.
At Apartment List, we carefully consider a variety of factors to determine compensation for each position, including the role, level, and work. The US Total Target Compensation (TTC) for this position is:
Zone 1: $210,000 - $255,000 TTC (including $189,000 - $229,000 base salary) + equity
Zone 2: $194,000 - $236,000 TTC (including $175,000 - $212,000 base salary) + equity
Zone 3: $179,000 - $217,000 TTC (including $161,000 - $195,000 base salary) + equity
This reflects the compensation target for new hire salaries for the position across all US locations. Please note, the compensation details provided do not include benefits and perks that we offer.

Nice-to-haves

Experience with Kubernetes-based data infrastructure
Experience leading a legacy ETL-to-modern-orchestration migration end-to-end, not just contributing to one.
Familiarity with observability and monitoring tooling such as Datadog at a platform-wide scale.
Experience building internal tooling or automation (including AI-assisted) that other engineers rely on.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

ci/cdgoaikubernetes

Platform: gem
Effort: medium