Job description

About the Role: ML developers today face significant friction in taking trained models into deployment. They work in a highly fragmented space, with incomplete and patchwork solutions that require significant performance tuning and non-generalizable, model-specific enhancements. At Modular, we are building the next generation AI platform that will radically improve the way developers build and deploy AI models. As part of our mission to build AI's unified compute layer, we are expanding the Modular software stack to a variety of new and exciting hardware platforms. We are looking for an Engineering Manager to lead the Hardware Bringup team at Modular. In this role, you will own the end-to-end delivery of accelerator bring-up across the Modular stack from Mojo kernels and the graph compiler to MAX model serving across multiple concurrent hardware partnerships.This is a hands on management role: You will work with the HW Bringup architect to set the team roadmap and the technical direction, align stakeholders and ensure all projects are delivered on time. You will participate in design reviews and Pre-sales discussions.. You will be accountable for scoping and delivering against engineering Statements of Work (SOWs) with vendor counterparts, and for growing a high-trust team that consistently ships against ambitious, externally-committed milestones. LOCATION: Candidates based in the US, Canada, and UK are welcome to apply. You can work in our office in Los Altos, CA, or Edinburgh, or remotely from home. Onboarding for new hires is conducted in-person at the appropriate office. What you will do: • Lead, mentor, and grow a 2 to 7 people team of mixed skillset (compiler, kernel, and runtime engineers) focused on bringing up new accelerator architectures across the Modular stack. • Stay hands-on: participate directly in design reviews, contribute to architecture and prototypes, write and review code for non-trivial portions of the stack (Mojo kernels, MLIR passes, runtime integration), and strive to unblock the hardest technical issues on the team. • Support end-to-end delivery of one or more hardware platform enablement efforts, from initial viability and dev-environment bring-up through merged compiler integration, kernel development, MAX serving, and production-quality model deployment. • Contribute to Statement of Work (SOW) scoping, milestone definition, and acceptance criteria with hardware partners, including translating engineering plans into contractual milestones, negotiating timelines, and managing delivery against commercial commitments. • Partner with Kernels, Graph Compiler, MAX, and Cloud teams to align roadmaps, resolve cross-team dependencies, and produce credible FTE plans and forecasts for executive review. • In collaboration with Head of Mojo, hire to a high bar: define the engineering profile, run interview loops, calibrate the team, and close senior candidates. • Foster a write-things-down, demo-driven engineering culture; ensure the team shares findings on new architectures (ISAs, memory hierarchies, vendor toolchains) through write-ups, internal demos, and onsites. What you bring to the table: • 7+ years of industry experience in compiler engineering, high-performance computing, kernel development, or related domains, with 2+ years managing engineers (strong IC-to-manager transitions welcome). • Strong technical foundation in compilers, systems software, or accelerator programming • Sufficient to be hands-on with the team's codebase, lead architecture discussions, and credibly review designs in MLIR/LLVM, kernel codegen, or runtime systems. • Proficiency in C++ and direct experience working in complex, multi-component software systems. • Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar), as a contributor rather than only a user. • Demonstrated track record of delivering multi-quarter technical roadmaps with external dependencies, including managing scope, risk, and external commitments. • Experience working directly with hardware vendor engineering teams joint bring-up efforts, partner escalations, or vendor-facing technical leadership. • Experience scoping or negotiating engineering deliverables under formal agreements (SOWs, joint engineering plans, or equivalent contractual frameworks). • Strong written communication Helpful, but not required: • Experience leading bring-up on non-GPU accelerators (DSPs, NPUs, custom ASICs, or other novel architectures). • Familiarity with MLIR or LLVM compiler infrastructure at a contributor level. • Background in AI compilers, kernel libraries, or GPU DSLs/DSELs such as Triton, CUTLASS, or CuTe. • Familiarity with how AI operators are implemented at a low level — custom kernels, fused operators, or framework-level integration (e.g., PyTorch at the C++ layer). • Experience drafting, negotiating, or executing engineering SOWs with hardware vendors or cloud partners. • Exposure to model serving or inference optimization workflows at production scale. What Modular brings to the table: • Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders. • World-class Benefits. In order to attract the best, we need to offer the best. Your benefits package may include comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities. Please note that specific benefit packages may vary based on your location, you can read more about benefits offered by Qualcomm here . • Competitive Compensation. We offer very strong compensation packages, including RSU grants. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce. • Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles. Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and a purpose to truly change the world. The estimated base salary range for this role to be performed in the US, regardless of the state, is $216,000–$372,000 USD . The estimated base salary range for this role to be performed in Canada, regardless of the province, is $207,000–$310,000 CAD . The estimated base salary range for this role to be performed in Edinburgh is £ 120,000– £206 ,400 GBR. The salary for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future. The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of total compensation. For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have upcoming openings at lower or higher levels than the one advertised.

Requirements

Must-haves

Lead, mentor, and grow a 2 to 7 people team of mixed skillset (compiler, kernel, and runtime engineers) focused on bringing up new accelerator architectures across the Modular stack.
Partner with Kernels, Graph Compiler, MAX, and Cloud teams to align roadmaps, resolve cross-team dependencies, and produce credible FTE plans and forecasts for executive review.
In collaboration with Head of Mojo, hire to a high bar: define the engineering profile, run interview loops, calibrate the team, and close senior candidates.
Foster a write-things-down, demo-driven engineering culture; ensure the team shares findings on new architectures (ISAs, memory hierarchies, vendor toolchains) through write-ups, internal demos, and onsites.
7+ years of industry experience in compiler engineering, high-performance computing, kernel development, or related domains, with 2+ years managing engineers (strong IC-to-manager transitions welcome).
Strong technical foundation in compilers, systems software, or accelerator programming
Sufficient to be hands-on with the team's codebase, lead architecture discussions, and credibly review designs in MLIR/LLVM, kernel codegen, or runtime systems.
Proficiency in C++ and direct experience working in complex, multi-component software systems.
Hands-on experience with at least one heterogeneous programming model (CUDA, SYCL, OpenCL, or similar), as a contributor rather than only a user.
Demonstrated track record of delivering multi-quarter technical roadmaps with external dependencies, including managing scope, risk, and external commitments.
Experience working directly with hardware vendor engineering teams joint bring-up efforts, partner escalations, or vendor-facing technical leadership.
Experience scoping or negotiating engineering deliverables under formal agreements (SOWs, joint engineering plans, or equivalent contractual frameworks).
Strong written communication
Experience leading bring-up on non-GPU accelerators (DSPs, NPUs, custom ASICs, or other novel architectures).
Familiarity with MLIR or LLVM compiler infrastructure at a contributor level.
Background in AI compilers, kernel libraries, or GPU DSLs/DSELs such as Triton, CUTLASS, or CuTe.
Familiarity with how AI operators are implemented at a low level — custom kernels, fused operators, or framework-level integration (e.g., PyTorch at the C++ layer).
Experience drafting, negotiating, or executing engineering SOWs with hardware vendors or cloud partners.
Exposure to model serving or inference optimization workflows at production scale.
Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
Competitive Compensation. We offer very strong compensation packages, including RSU grants. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.
Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and a purpose to truly change the world.
For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply, as we may have upcoming openings at lower or higher levels than the one advertised.

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

mlaiagile

Platform: gem
Effort: medium

Benefits

Benefits detected in the listing.

Paid Time Off