AI Solution Architect at Penguin Solutions

Job description

At Penguin Solutions (Nasdaq: PENG) – The AI Factory Platform Company – we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide. Headquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale. Penguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision. At Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact. Job Overview As an AI Solution Architect , you will be the lead technical visionary in our pre-sales process, acting as the trusted advisor to our clients and the technical conscience for our sales team. You will be responsible for translating complex customer challenges into elegant, feasible, and compelling end-to-end AI solutions. This is a deeply technical, customer-facing role where you will have the opportunity to design cutting-edge agentic AI systems on the industry-leading NVIDIA AI Enterprise platform. If you are a master of the whiteboard, passionate about solving complex problems, and skilled at bridging the gap between business objectives and technical implementation, this role is for you. Responsibilities Lead Pre-Sales Technical Discussions • Engage directly with prospective clients to lead deep technical discovery sessions. You will be responsible for understanding and documenting their business goals, technical requirements, and operational constraints. Design End-to-End Solutions • Act as the lead architect in designing comprehensive, end-to-end agentic AI solutions. Your designs will be centered on the NVIDIA AI Enterprise platform and will encompass the full stack, from hardware and networking to MLOps and application layers. Act as Primary Technical Author • Serve as the primary technical author for all service project proposals, statements of work (SOWs), and detailed architectural documentation. You will ensure that every solution is technically sound, feasible, and directly aligned with the customer's business objectives. Present and Defend Solutions • Drive the presentation of all technical and architectural proposal content. You must be able to confidently present to a wide range of audiences, from deeply technical engineers to C-level executives, and handle challenging questions and objections. Manage Technical Scope and Timelines • Concurrently manage multiple project design and architecture development activities. You will be responsible for clearly communicating project deliverables, milestones, potential risks/mitigations, and likely development and delivery timelines to both customers and internal teams. Stay on the Cutting Edge • You will be expected to remain up to date on the latest full-stack AI software, hardware, and delivery capabilities to ensure that Penguin's solutions are always best-in-class. Qualifications • 7+ years of experience in a customer-facing, pre-sales technical role such as Solutions Architect, Pre-Sales Engineer, or a similar capacity. • Deep, hands-on experience designing complex, large-scale enterprise systems (e.g., in AI/ML, HPC, Big Data, or enterprise software). • Exceptional presentation, whiteboarding, and communication skills, with a demonstrated ability to present complex technical topics to both technical and nontechnical audiences. • Deep, hands-on experience architecting and building solutions at the application and model layers of the AI stack , including generative AI, agentic AI, RAG, model integration, inference, and production AI application development. • Proven ability to manage multiple, concurrent design and architecture projects in a fast-paced sales environment. • Experience designing production-grade AI platforms and applications with considerations for security, governance, evaluation, observability, scalability, reliability, and cost optimization. • A strong understanding of the interplay between software, hardware, and networking in modern data center environments. Preferred Qualifications • Deep technical expertise with the NVIDIA AI software stack (NVIDIA AI Enterprise, Triton Inference Server, NeMo, TensorRT-LLM, etc.) and underlying hardware platforms (e.g., DGX, HGX). • Experience designing solutions for LLM inference, agentic AI systems, or other advanced AI workloads. • Experience building enterprise AI solutions using comparable AI platforms and frameworks from major cloud or technology providers, such as Azure AI Foundry, AWS Bedrock/SageMaker, Google Vertex AI, Databricks, Hugging Face, or similar platforms. • Hands-on experience deploying and operationalizing AI/ML models in on-premises environments , including model serving, inference infrastructure, containerization, GPU acceleration, scaling, monitoring, and integration with enterprise systems. • Familiarity with MLOps principles, CI/CD, and container orchestration (Kubernetes). Location This is a remote position in the United States. Travel Flexible (with travel to client sites and Penguin Solutions offices as needed) Compensation & Benefits The base pay range that the Company reasonably expects to pay for this position in the United States is $130,000 - $175,000; the pay ultimately offered may vary based on business considerations, including job-related knowledge, skills, experience, and education. The position is bonus-eligible, and there are medical, dental, and vision benefits available. There is a 401k saving plan and other benefits, such as Paid Time Off, Life Insurance, and an Employee Assistance Plan. Inclusion & Belonging Statement We are committed to creating an inclusive environment that embraces differences and fosters belonging for all. Equal Opportunity Statement We are an Affirmative Action/Equal Opportunity Employer and strongly committed to all policies which will afford equal opportunity employment to all qualified persons without regard to age, national origin, race, ethnicity, creed, gender, disability, veteran status, or any other characteristic protected by law.

Requirements

Must-haves

Job Overview
Lead Pre-Sales Technical Discussions
Engage directly with prospective clients to lead deep technical discovery sessions. You will be responsible for understanding and documenting their business goals, technical requirements, and operational constraints.
Design End-to-End Solutions
Act as Primary Technical Author
Present and Defend Solutions
Manage Technical Scope and Timelines
Stay on the Cutting Edge
You will be expected to remain up to date on the latest full-stack AI software, hardware, and delivery capabilities to ensure that Penguin's solutions are always best-in-class.
7+ years of experience in a customer-facing, pre-sales technical role such as Solutions Architect, Pre-Sales Engineer, or a similar capacity.
Deep, hands-on experience designing complex, large-scale enterprise systems (e.g., in AI/ML, HPC, Big Data, or enterprise software).
Exceptional presentation, whiteboarding, and communication skills, with a demonstrated ability to present complex technical topics to both technical and nontechnical audiences.
Proven ability to manage multiple, concurrent design and architecture projects in a fast-paced sales environment.
Experience designing production-grade AI platforms and applications with considerations for security, governance, evaluation, observability, scalability, reliability, and cost optimization.
A strong understanding of the interplay between software, hardware, and networking in modern data center environments.

Nice-to-haves

Deep technical expertise with the NVIDIA AI software stack (NVIDIA AI Enterprise, Triton Inference Server, NeMo, TensorRT-LLM, etc.) and underlying hardware platforms (e.g., DGX, HGX).
Experience designing solutions for LLM inference, agentic AI systems, or other advanced AI workloads.
Familiarity with MLOps principles, CI/CD, and container orchestration (Kubernetes).
This is a remote position in the United States.
Flexible (with travel to client sites and Penguin Solutions offices as needed)

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlllmazureawsci/cdkubernetes

Platform: successfactors
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401k

Paid Time Off