Software Dev Engineer II, Long Term Planning and Forecasting

• You'll design and build production systems at the intersection of LLMs, multi-agent orchestration, and large-scale data retrieval
• You'll work on novel problems: agentic routing with confidence calibration, stochastic evaluation, and authorization-aware knowledge retrieval
• You'll ship visible impact — PIXIE is LTPF's flagship AI investment with VP-level visibility and direct analyst adoption metrics
• Tight engineering team (8 SDEs), high autonomy, rapid iteration cycles
• Key job responsibilities
• Design, build, and operate core platform services for PIXIE's agentic AI system — including agent runtime, caching/cost-latency optimization, observability, and evaluation infrastructure
• Build and maintain the tool/agent registry that enables new capabilities to be discovered and invoked without redeployment
• Develop automated evaluation and regression harnesses for non-deterministic LLM outputs — hallucination detection, drift monitoring, and faithfulness scoring
• Implement authorization-aware retrieval ensuring users never see content they aren't entitled to
• Collaborate with Scientists on grounding methodology, causal analytics productionization, and retrieval-quality optimization
• Operate what you build — on-call rotation, runbooks, operational dashboards, and continuous improvement of system reliability
• Mentor teammates on system design, code quality, and operational best practices
• About the team
• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of software development engineer or related occupational experience
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 1+ years of Object Oriented Design experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
• Experience programming with at least one software programming language
• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
• USA, WA, Bellevue - 143,700.00 - 194,400.00 USD annually

None flagged.