Software Engineer-AI/ML, Inference Team - AWS Neuron

• Key job responsibilities
• Broaden the range of models supported out of the box, and build tooling and automation that shortens the path from a new model to a production-ready deployment.
• Improve model development and shipping velocity by reducing enablement time for new models and strengthening the test, benchmarking, and release workflows the team relies on.
• Apply strong engineering practices — code reviews, testing, and operational excellence — to ship reliable, high-performance inference that customers depend on.
• About the team
• 3+ years of non-internship professional software development experience
• 3+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 2+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
• Experience in debugging, profiling, and implementing software engineering best practices in large-scale systems
• Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
• Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution
• Kernel development experience (e.g., CUDA, Triton)
• Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
• USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually

None flagged.