In this pivotal role, you will build and lead the team that designs state-of-the-art autograder systems evaluating AI product quality at scale.
MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
1+ years of industry experience building LLM/VLM-based evaluators, autograders, or automated evaluation systems.
5+ years of hands-on experience in machine learning, model alignment, or benchmark creation.
Track record of managing teams of 3+ machine learning engineers and/or AI scientists.
Deep understanding of GenAI models and their evaluation methodologies, including rubric design, evaluation set development, validation, calibration, and human-model alignment.
Strong technical judgment and a track record of leading complex, ambiguous AI/ML projects from definition through delivery.
Experience translating emerging GenAI techniques and research into reliable, production-ready systems.
Experience scaling AI/ML solutions into reusable platforms, frameworks, or standardized workflows.
Demonstrated track record of developing senior machine learning engineers and/or technical leads.
Demonstrated ability to align diverse stakeholders around strategy, navigate complex situations, and drive effective outcomes across organizations.