Member of Technical Staff - Evaluations

• Conduct critical comparative analysis to advance our understanding of model capabilities
• Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior
• Develop generalizable evaluation frameworks that capture what matters for reasoning, alignment, and usefulness.
• Collaborate closely with pre-training, post-training, and applied teams to translate insights into model improvements.
• Push the boundaries of what’s measurable, from synthetic evals to human feedback and real-world interaction data.
• Strong statistical analysis and experimental design skills to rigorously measure model improvements
• Familiarity with LLM evaluation methodologies: static benchmarks, human preference evals, and/or agentic tasks.
• High agency and thrive in a fast-paced startup environment; bias for impact over process.
• Excited to work in a new frontier lab, defining how we measure and accelerate progress toward more capable models.
• Collaborative, detail-oriented, and motivated by building the feedback loops that make models truly improve.

None flagged.