Senior Solutions Architect, AI Inference

• Work with inference partners who build cutting-edge inference services, teach them the value of our stack and bring back product insights that benefit the whole industry.
• Build and operate inference recipes with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency.
• Accelerate inference pipelines using TensorRT-LLM, vLLM, SGLang, and other backends to ensure seamless integration with disaggregated inference.
• Evangelize devops best-practices for such as managing kubernetes clusters, configuring compute fabrics, and observability.
• Provide mentorship and technical leadership to customers and internal teams, guiding them through the deployment of disaggregated inference systems and resolving complex issues.
• 6+ Years in Solutions Architecture (or Solution Engineering, Forward-Deployed Engineering, or similar) driving customer engagements to deploy distributed systems, including 2+ years with AI workloads on Kubernetes.
• Experience with one of NVIDIA Dynamo, Triton Inference Server, or TensorRT-LLM for model optimization and serving.
• Deep knowledge of modern inference best practices including disaggregated serving, multi-tier KV cache management, speculative decoding, quantization and custom inference kernels.
• Hands-on full-stack agent design with modern sandboxing, memory and retrieval systems with evaluation, skill design and governance.
• BS in CS/Engineering or equivalent experience.
• Prior experience deploying NVIDIA inference technologies such as Dynamo, NIXL and Grove.
• Experience with model customization techniques such as SFT, DPO, GRPO, RLVR and corresponding data curation techniques.
• Contributions to open-source projects relevant to the above.
• You will also be eligible for equity and benefits .
• Applications for this job will be accepted at least until August 31, 2026.
• This posting is for an existing vacancy.
• NVIDIA uses AI tools in its recruiting processes.

None flagged.