Job description

NVIDIA needs a Senior Product Manager to lead Switchyard, our adaptive inference runtime for systems of models. We build Switchyard to help agentic applications choose among models, providers, tools, reasoning strategies, and runtime configurations to improve task-level quality, cost, latency, and policy compliance without requiring teams to rewrite their agents. You will turn a fast-moving research agenda and a growing partner ecosystem into open source tools that impact model routing and adaptive inference across the industry. What you’ll be doing: • Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering. • Work directly with agent harness builders, inference gateways, model serving systems, and other partners to make integrations successful and turn market feedback into stronger product capabilities. • Define the developer experience and product interfaces for adaptive inference. • Partner with Research to translate advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features. • Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments. • Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks. • Establish the messaging and narrative for how our teams talk about model routing and adaptive inference, working together with Product Marketing. • Define and inspect the evidence for success. Own the outcomes. • Coordinate across adjacent teams to build compelling joint product outcomes.. What we need to see: • Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience. • 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners. • A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application. • Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs. Able to reason clearly about quality/cost/latency tradeoffs. • Ability to engage mature customers and partners independently, uncover real production constraints, and guide GTM teams through complex technical adoption. • Positive relationships with Engineering and Research teams. Ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation. • An evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria. • Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across organizational boundaries. • Enough technical depth to inspect APIs, traces, and benchmark results directly and earn the trust of senior researchers and engineers. Ways to stand out from the crowd: • Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute. • Experience taking research from prototype to a reliable, adopted developer product. • A track record with open-source communities, SDKs, platform integrations, or developer ecosystems. • Hands-on familiarity with relevant adjacent topics like agent building, eval systems, and inference optimization. With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most hard-working and dedicated people on the planet working for us and, due to outstanding growth, our Product Management teams are growing fast. If you’re a creative technologist with a genuine passion for these topics, we want to hear from you! Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 208,000 USD - 327,750 USD for Level 5. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until October 6, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Requirements

Must-haves

Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering.
Work directly with agent harness builders, inference gateways, model serving systems, and other partners to make integrations successful and turn market feedback into stronger product capabilities.
Define the developer experience and product interfaces for adaptive inference.
Partner with Research to translate advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features.
Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments.
Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks.
Establish the messaging and narrative for how our teams talk about model routing and adaptive inference, working together with Product Marketing.
Define and inspect the evidence for success. Own the outcomes.
Coordinate across adjacent teams to build compelling joint product outcomes..
Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience.
8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners.
A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application.
Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs. Able to reason clearly about quality/cost/latency tradeoffs.
Ability to engage mature customers and partners independently, uncover real production constraints, and guide GTM teams through complex technical adoption.
Positive relationships with Engineering and Research teams. Ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation.
An evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across organizational boundaries.
Enough technical depth to inspect APIs, traces, and benchmark results directly and earn the trust of senior researchers and engineers.
Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute.
Experience taking research from prototype to a reliable, adopted developer product.
A track record with open-source communities, SDKs, platform integrations, or developer ecosystems.
Hands-on familiarity with relevant adjacent topics like agent building, eval systems, and inference optimization.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until October 6, 2026.

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlllm

Platform: eightfold
Effort: medium