Base Labs Research Scientist at Baseten

Job description

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F baseten.co, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE This role sits at the frontier of our research agenda. You will pursue open problems at the intersection of post-training methodology and performant inference, and then collaborate with research engineering to translate findings into production systems. A meaningful portion of your time will be dedicated to research that deepens our understanding of how models learn, alignment, and architectural efficiency — questions that may not have immediate product application. The remainder will be directed toward research that solves concrete problems for Baseten's platform and customers, who are the fastest growing AI companies in the world like Cursor, Lovable, and Notion. We are looking for someone with sharp research taste and genuine creative instinct for problem selection. Someone who can identify questions that matter, design clean experiments to answer them, and push the state of the art. The environment here is not theoretical, but rather research that can be validated with eager customers who are serving billions of tokens a second. The Manifesto: labs.baseten.co RECENT RESEARCH - Towards infinite context windows: neural KV cache compaction baseten.co - Dense, on-policy or both? baseten.co - Repeated kv cache for long-running agents baseten.co - Distillation without the dark – replicating black-box on-policy distillation on Baseten baseten.co RESPONSIBILITIES - Define and pursue a research agenda spanning both foundational and applied work, with the applied component connected to Baseten's platform and customer needs. - Design and execute rigorous experiments, frequently at meaningful scale (multi-node, trillion parameter models). - Work with customers to translate domain-specific requirements into research problems, where relevant to your agenda. - Publish at top venues (NeurIPS, ICML, ICLR) and establish Baseten's research presence. - Collaborate with model performance and training infrastructure teams to bridge research findings and inference production systems. - Mentor junior researchers and shape the technical direction of the research organization as it grows. PREFERRED QUALIFICATIONS - Master’s or PhD research depth in machine learning, with first-author publications at top venues - Demonstrated ability to move from theory through implementation to empirical results — not exclusively theoretical or exclusively engineering work - Judgment about problem selection, the ability to distinguish research that advances a metric from research that changes how systems are built - Willingness to operate in a startup environment where the majority of research informs product decisions, with timelines measured in months rather than years - Background spanning multiple research areas (e.g., both interpretability and RL, or both systems and training methodology) - Track record of open-source contributions or community building in ML research OUR VIEW ON TALENT Many of the labs that exist today run a credentialist talent model. Concentrate the most already-legible researchers, and assume the concentration compounds. The best researchers in this field are very often not yet legible. Research engineers who have spent years inside a production stack and developed insights no PhD program teaches; PhDs working on the wrong-shaped problem at the right-shaped lab; operators who have been close to real systems long enough to see things credentialed researchers have never had to see. If you don’t have the traditional qualifications and are doing exceptional work, we’d love to chat. BENEFITS - Competitive compensation, including meaningful equity - (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents - Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!) - Paid parental leave - Fertility and family-building stipend through Carrot - (U.S. only) Company-facilitated 401(k) - Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities. Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you. At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Requirements

Must-haves

Towards infinite context windows: neural KV cache compaction https://www.baseten.co/research/towards-infinite-context-windows-neural-kv-cache-compaction/
Distillation without the dark – replicating black-box on-policy distillation on Baseten https://www.baseten.co/research/distillation-without-the-dark/
Define and pursue a research agenda spanning both foundational and applied work, with the applied component connected to Baseten's platform and customer needs.
Design and execute rigorous experiments, frequently at meaningful scale (multi-node, trillion parameter models).
Work with customers to translate domain-specific requirements into research problems, where relevant to your agenda.
Publish at top venues (NeurIPS, ICML, ICLR) and establish Baseten's research presence.
Collaborate with model performance and training infrastructure teams to bridge research findings and inference production systems.
Mentor junior researchers and shape the technical direction of the research organization as it grows.

Nice-to-haves

Master’s or PhD research depth in machine learning, with first-author publications at top venues
Demonstrated ability to move from theory through implementation to empirical results — not exclusively theoretical or exclusively engineering work
Judgment about problem selection, the ability to distinguish research that advances a metric from research that changes how systems are built
Willingness to operate in a startup environment where the majority of research informs product decisions, with timelines measured in months rather than years
Background spanning multiple research areas (e.g., both interpretability and RL, or both systems and training methodology)
Track record of open-source contributions or community building in ML research

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimachine learningml

Platform: ashby
Effort: quick

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Pto

Parental Leave