Job description

We are looking for a senior systems software engineer to improve the operation and user experience of distributed system infrastructure using AI. We are passionate about the opportunity to shape the future of the NVIDIA software platform! We want to develop next-generation AI-powered infrastructure that scales to run millions of requests and jobs on thousands of servers efficiently, reliably, and securely. What you will be doing: • Design, build, test, deploy, and maintain software infrastructure APIs and services. • Collaborate effectively with peers and partners through brainstorming and review sessions to produce high-quality design, code, and documentation. • Review, recommend, and model best practices of distributed systems for reliability, performance, monitoring, security, compliance, interoperability, usability, correctness, consistency, simplicity, etc. • Support other NVIDIA teams in using this foundational infrastructure. • Debug production issues across services and multiple levels of the stack. What we need to see: • Bachelor’s degree or equivalent experience. • More than 8 years dedicated to software engineering in one or more programming languages, including data structures and algorithms. • 2 years of experience designing, testing, maintaining and/or launching distributed systems. Ways to stand out from the crowd: • Experience with Agentic AI frameworks and patterns. • Background with container technologies such as Docker and Kubernetes. • Experience with DevOps tools such as Ansible, Terraform, and Jenkins. • Knowledge of the Java programming language and web frameworks such as Spring Boot. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until August 4, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Requirements

Must-haves

Design, build, test, deploy, and maintain software infrastructure APIs and services.
Collaborate effectively with peers and partners through brainstorming and review sessions to produce high-quality design, code, and documentation.
Review, recommend, and model best practices of distributed systems for reliability, performance, monitoring, security, compliance, interoperability, usability, correctness, consistency, simplicity, etc.
Support other NVIDIA teams in using this foundational infrastructure.
Debug production issues across services and multiple levels of the stack.
Bachelor’s degree or equivalent experience.
More than 8 years dedicated to software engineering in one or more programming languages, including data structures and algorithms.
2 years of experience designing, testing, maintaining and/or launching distributed systems.
Experience with Agentic AI frameworks and patterns.
Background with container technologies such as Docker and Kubernetes.
Experience with DevOps tools such as Ansible, Terraform, and Jenkins.
Knowledge of the Java programming language and web frameworks such as Spring Boot.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 4, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aidockerkubernetesjava

Platform: eightfold
Effort: medium