Job description

NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further! What you'll be doing: • Design and build performance analysis tools and workflows for AI training and inference workloads. • Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling. • Develop integrations between profiling infrastructure and AI frameworks and workflows. • Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads. • Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them. What we need to see: • M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience • Deep knowledge of AI workloads, frameworks, and performance characteristics. • Experience building tools, workflows, or infrastructure used by other engineers. • Strong software development skills (Python, C++ preferred). • Ability to translate user requirements into scalable tooling solutions. • Up to date with AI-enabled tooling for software development and performance analysis. • Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams. Ways to stand out from the crowd: • Experience profiling or optimizing AI training or inference pipelines at scale • Background building developer tools or platforms for ML engineers • Contributions to open-source AI tooling or frameworks Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until August 16, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Requirements

Must-haves

Design and build performance analysis tools and workflows for AI training and inference workloads.
Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling.
Develop integrations between profiling infrastructure and AI frameworks and workflows.
Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads.
Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them.
M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience
Deep knowledge of AI workloads, frameworks, and performance characteristics.
Experience building tools, workflows, or infrastructure used by other engineers.
Ability to translate user requirements into scalable tooling solutions.
Up to date with AI-enabled tooling for software development and performance analysis.
Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams.
Experience profiling or optimizing AI training or inference pipelines at scale
Background building developer tools or platforms for ML engineers
Contributions to open-source AI tooling or frameworks
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 16, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.

Nice-to-haves

Strong software development skills (Python, C++ preferred).

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aipythonml

Platform: eightfold
Effort: medium