Sr. Data Engineer - Data Modeling & Governance at Yahoo

Job description

Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It’s the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever. A Little About Us The Yahoo Mail Data organization enables Yahoo to leverage data to power our customer’s intelligent experiences, make critical data-driven decisions and drive multiple business functions. Our team designs and governs the massive, distributed data foundation that powers experiences for hundreds of millions of active Yahoo Mail users globally. We design and build the future of how teams work with data with agentic automation across Data Engineering & Infrastructure. Our Data Platforms and Products empower Data Science & Analytics, AI/ML, Product, Marketing, Commerce, Finance and Business teams across Yahoo to turn multi-petabyte datasets into real-time consumer insights and next-generation agentic/GAI workflows and features. We are looking for exceptional Data Engineers to join our team and help guide, innovate and evolve our Data Models & our Data Governance practices. We are committed to building an inclusive team as we design the future of data at Yahoo Mail. Come help us build the future of Mail Data. Responsibilities Enterprise Data Modeling & Schema Design: Architect, optimize, and maintain Yahoo Mail’s foundational data models and schemas, delivering high-performance, cost-efficient data structures that serve multi-tenant consumers across Data Science, AI/ML, Product, and Marketing (IC5 level). Agentic Data Governance & Privacy by Design: Architect modern data governance methodologies for the agentic AI era—establishing formal ontologies, enterprise naming conventions, data lineage tracking, and automated quality validation engines while maintaining rigorous consumer privacy and security standards. AI-Ready Feature & ML Modeling: Design and implement optimized data layers and vector-ready feature stores that power real-time AI/ML Mail Intelligence, downstream generative AI agents, and personalized consumer product features. Distributed Architecture & Compute Optimization: Refine distributed data systems across cloud ecosystems (GCP/BigQuery/Dataflow), minimizing expensive analytical compute operations and maximizing query performance at massive global scale. AI-Augmented Engineering Workflows: Champion the adoption of AI-assisted engineering tools (such as GitHub Copilot Enterprise and Anthropic Claude via AWS Bedrock) to accelerate data pipeline scripting, automate schema documentation, and detect data quality anomalies. Architectural Judgment & Validation: Exercise expert architectural judgment in establishing safe boundaries between automated, AI-assisted code generation and deterministic data model design, preventing hallucinations and schema drift. Cross-Functional Technical Leadership: Collaborate closely with cross-functional engineering and stakeholder teams, acting as a technical authority with Data Science leads, Principal Architects, and Product Directors across Yahoo to align data schemas with strategic business goals and analytical requirements. Technical Stewardship & Mentorship: Chair data design reviews, establish organizational data modeling standards, and mentor senior data engineers across Yahoo Mail. Contribute to a culture: of continuous learning and growth. Basic Qualifications Bachelor’s or Master s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline (or equivalent practical experience). 10 years of professional software or data engineering experience, with a proven track record of architecting and owning significant, enterprise-scale data models (IC5 level). Demonstrated hands-on experience utilizing AI-assisted development platforms (e.g., GitHub Copilot, Cursor, LLM-driven query engines) to accelerate architectural design, SQL authoring, and pipeline optimization. Deep technical expertise in cloud-native distributed data architectures, data warehousing, and schema optimization at petabyte scale. Direct experience designing data models, feature stores, and data pipelines that directly feed production AI/ML models, Data Products for Insights, recommendation engines, or LLM applications. Proven experience defining enterprise data governance, metadata management, schema evolution, and end-to-end data lineage frameworks. Strong familiarity with modern DevOps and infrastructure practices (CI/CD, Terraform, container orchestration). Preferred Qualifications Hands-on expertise with Google Cloud Platform (GCP) or AWS data services at enterprise scale Hands-on experience with either BigQuery, Lakebase or Snowflake at enterprise scale. Experience with Pub/Sub, Dataflow, Kafka, Apache Flink, or other streaming technologies and low latency distributed caching layers. Experience architecting graph database structures or knowledge graphs to support entity resolution and relational data discovery. Experience designing real-time verification frameworks or guardrails for validating AI-generated data pipelines and automated query outputs. Familiarity with streaming architectures (Kafka, Apache Flink) and low-latency distributed caching layers. Strong technical writing and communication skills with a track record of authoring architecture RFCs and mentoring engineering squads. Deep knowledge of real-time data governance and AI-generated output validation. Demonstrated abilities in prompt engineering for automating technical documentation and system architecture mapping. The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies ; exercising sound judgment ; working effectively, safely and inclusively with others ; exhibiting trustworthiness and meeting expectations ; and safeguarding business operations and brand integrity. At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter! Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( www.yahooinc.com/careers/contact-us.html ) or call 1.866.772.3182 . Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response. We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome. The compensation for this position ranges from $128,250.00 - $266,875.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more. Currently work for Yahoo? Please apply on our internal career site.

Requirements

Must-haves

A Little About Us
Technical Stewardship & Mentorship: Chair data design reviews, establish organizational data modeling standards, and mentor senior data engineers across Yahoo Mail.
Contribute to a culture: of continuous learning and growth.
Bachelor’s or Master s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline (or equivalent practical experience).
10 years of professional software or data engineering experience, with a proven track record of architecting and owning significant, enterprise-scale data models (IC5 level).
Demonstrated hands-on experience utilizing AI-assisted development platforms (e.g., GitHub Copilot, Cursor, LLM-driven query engines) to accelerate architectural design, SQL authoring, and pipeline optimization.
Deep technical expertise in cloud-native distributed data architectures, data warehousing, and schema optimization at petabyte scale.
Direct experience designing data models, feature stores, and data pipelines that directly feed production AI/ML models, Data Products for Insights, recommendation engines, or LLM applications.
Proven experience defining enterprise data governance, metadata management, schema evolution, and end-to-end data lineage frameworks.
Strong familiarity with modern DevOps and infrastructure practices (CI/CD, Terraform, container orchestration).

Nice-to-haves

Hands-on expertise with Google Cloud Platform (GCP) or AWS data services at enterprise scale
Hands-on experience with either BigQuery, Lakebase or Snowflake at enterprise scale.
Experience with Pub/Sub, Dataflow, Kafka, Apache Flink, or other streaming technologies and low latency distributed caching layers.
Experience architecting graph database structures or knowledge graphs to support entity resolution and relational data discovery.
Experience designing real-time verification frameworks or guardrails for validating AI-generated data pipelines and automated query outputs.
Familiarity with streaming architectures (Kafka, Apache Flink) and low-latency distributed caching layers.
Strong technical writing and communication skills with a track record of authoring architecture RFCs and mentoring engineering squads.
Deep knowledge of real-time data governance and AI-generated output validation.
Demonstrated abilities in prompt engineering for automating technical documentation and system architecture mapping.
Currently work for Yahoo? Please apply on our internal career site.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlgcpawsllmsqlci/cdaccessibility

Platform: workday
Effort: long

Benefits

Benefits detected in the listing.

401k