Job description

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY is the only professional services firm with a separate business unit (“FSO”) that is dedicated to the financial services marketplace. Our FSO teams have been at the forefront of every event that has reshaped and redefined the financial services industry. If you have a passion for rallying together to solve the most complex challenges in the financial services industry, come join our dynamic FSO team! The business problems our clients are facing today are not the same problems they have faced in the past. The rapid pace of development in Artificial Intelligence and the technology that enables it has created an urgent need to innovate and adapt to the new global business paradigm. Financial institutions are looking to build smarter and more efficient ways to operate their business, create new revenue streams, and better manage risk, through new opportunities uncovered by their data. We believe that to fully unlock the potential of Artificial Intelligence, we need to look not only at its application, but also at the strategy level for how best to transform the enterprise into one that is technology and data focused and ready for the new age. Our clients’ problems are becoming increasingly complex while at the same time the need to automate and streamline is rising. The Opportunity Supports the delivery of solution or infrastructure development services for AI/ML initiatives, applying strong technical capability and hands-on engineering experience. Contributes to the design, development, delivery, and maintenance of AI-enabled solutions or infrastructure while aligning to relevant engineering standards and project delivery expectations. Understands business and user requirements and helps translate them into sound technical designs and implementation plans. Contributes to the integration of AI/ML capabilities into broader enterprise solutions, with a focus on quality, scalability, and user impact. Your Key Responsibilities • Design, develop, test, deploy, and support production-grade AI/ML, generative AI, and intelligent automation solutions. • Solve complex technical problems through coding, debugging, testing, troubleshooting, and structured design remediation. • Translate business and user requirements into technical designs, APIs, workflows, and supportable implementation patterns. • Build and integrate LLM, RAG, and agentic solution components into enterprise applications and platforms. • Contribute to system design across service boundaries, orchestration layers, data flows, security controls, and external integrations. • Support project delivery through disciplined execution, estimation, documentation, status communication, and risk identification. • Partner with Development, Engineering, Product, Data, Architecture, and project leadership teams to deliver high-value AI capabilities. • Improve performance, resilience, maintainability, and cost efficiency of deployed AI systems. • Participate in architecture and design reviews, providing thoughtful trade-off analysis and implementation input. • Use modern AI-assisted software engineering tools such as Claude Code, Codex, or equivalent agentic coding platforms as part of day-to-day engineering delivery. AI and Engineering Skills: Gen AI Foundational: • Ability to understand business challenges and translate them into value-add AI solutions leveraging large language models and intelligent automation • Experience designing, building, and maintaining production-grade LLM applications, including end-to-end pipelines from data ingestion through model output delivery (e.g. Azure OpenAI, AWS Bedrock, Google Vertex AI) • Demonstrated experience building retrieval-augmented systems that ground model outputs in enterprise knowledge sources, including chunking strategies, embedding pipelines, and retrieval optimization (e.g. LlamaIndex, LangChain, Pinecone, Weaviate, Azure AI Search, pgvector etc.) • Knowledge of embedding models, vector search, and semantic retrieval patterns used to ground LLM outputs in enterprise knowledge sources (e.g. OpenAI Embeddings, Azure AI Search, pgvector etc.) • Proficiency in prompt engineering techniques including zero-shot, few-shot, chain-of-thought, and structured output design, with the ability to systematically evaluate and iterate on prompt performance(e.g. DSPy, PromptFlow etc.) Agentic and LLM Ops: • Experience designing and building agentic systems including multi-agent orchestration patterns, tool use, and memory design across single and multi-step workflows (e.g. LangGraph, AutoGen, CrewAI, Semantic Kernel, NVIDIA NIM etc.) • Ability to build reliable agent loops including failure handling, retries, fallbacks, and context window management across complex multi-step agentic workflows • Ability to debug, troubleshoot, and remediate production LLM and agentic systems including failure diagnosis across retrieval, orchestration, and generation layers • Experience designing and implementing LLM evaluation frameworks covering functional correctness, output quality, safety, and business-defined KPIs (e.g. RAGAS, DeepEval, Arize Phoenix etc.) Software Engineering: • Hands-on software engineering proficiency in Python, with the ability to write clean, modular, production-quality code for LLM pipelines and agentic applications • Experience working with structured and unstructured data sets to support LLM application development, including data curation, preparation, and quality validation for model inputs • Familiarity with RESTful and event-driven API patterns including asynchronous workflows, service boundaries, and integration of enterprise data sources to expose LLM and agentic capabilities • Familiarity with containerization and orchestration concepts for packaging and deploying LLM applications in cloud environments (e.g. Docker, Kubernetes, Azure Container Apps, AWS ECS etc.) • Understanding of software engineering best practices as applied to ML systems, including modular code design, testing patterns for AI pipelines, and data quality validation Soft Skills and additional attributes for success: • Clear communicator able to explain complex AI system behavior and trade‑offs to technical and non‑technical stakeholders, including risk and compliance. • Strong ownership and accountability, taking responsibility for AI systems from design through production and issue resolution. • Comfort with ambiguity, able to operate effectively as requirements, regulations, and technologies evolve. • Collaborative and cross‑functional, working closely with engineering, product, risk, legal, and audit teams. • Sound judgment in regulated environments, with awareness of risk, controls, and when human oversight is required. • Bachelor’s degree preferred. • 3+ years of applied engineering experience, including meaningful experience in AI/ML engineering roles. Demonstrated experience in the following areas will be a huge plus: • Ability to build and maintain model observability pipelines including tracing of multi-step agentic reasoning chains, output degradation detection, and behavioral drift monitoring in production (e.g. LangSmith, Arize, Datadog, Azure Monitor etc.) • Familiarity with LLM fine-tuning approaches including instruction tuning and preference optimization, with an understanding of when fine-tuning is appropriate versus prompt-based solutions (e.g. LoRA, QLoRA, PEFT, NeMo Framework etc.) • Familiarity with inference optimization principles — latency, throughput, and cost management — to support scalable and cost-effective LLM deployment • Familiarity with AI security considerations relevant to LLM systems, including prompt injection risks, adversarial input handling, and audit trail requirements • Familiarity with responsible AI principles including bias and fairness evaluation, human-in-the-loop design, and explainability approaches in the financial services contexts • Familiarity with data pipeline design for AI workloads including ingestion, transformation, and quality validation • Familiarity with cloud-based platforms for building, training, and deploying scalable LLM solutions (e.g. Azure ML, AWS SageMaker, Google Vertex AI etc.) • Familiarity with AI-assisted software engineering tools for accelerating development, implementation, and code review practices (e.g. Claude Code, GitHub Copilot, Codex etc.) Ideally, you’ll also have • Master’s degree in Business Administration (MBA) or Science (MS) preferred • Prior consulting experience What we offer you At EY, we harness our collective strength to empower you to shape your future with confidence through professional growth, personal fulfillment and an inclusive culture. Learn more at ey.com/us/careers. • We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job is: • • New York City, Boston, and Washington DC Metro Areas, Washington State, and Southern California offices – $134,700 to $202,200 • Bay Area California offices – $140,400 to $210,700 • All other offices locations in the US, including Sacramento – $112,300 to $185,400 • Individual salaries within these ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options. • Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. Are you ready to shape your future with confidence? Apply today. • To make the most of your application experience, please limit yourself to two applications within a six-month period. • EY accepts applications for this position on an on-going basis. • For those living in California, please click here for additional information. • At EY, our values set the foundation for how we work and the behaviors we expect of our people. Any misrepresentation or falsification of information or lack of integrity at any point in the recruiting process may result in withdrawal of your candidacy, revocation of an offer or immediate termination of employment. EY | Building a better working world EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories. All in to shape the future with confidence. EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.  EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com .

Requirements

Must-haves

At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.
Your Key Responsibilities
Design, develop, test, deploy, and support production-grade AI/ML, generative AI, and intelligent automation solutions.
Solve complex technical problems through coding, debugging, testing, troubleshooting, and structured design remediation.
Translate business and user requirements into technical designs, APIs, workflows, and supportable implementation patterns.
Build and integrate LLM, RAG, and agentic solution components into enterprise applications and platforms.
Contribute to system design across service boundaries, orchestration layers, data flows, security controls, and external integrations.
Support project delivery through disciplined execution, estimation, documentation, status communication, and risk identification.
Partner with Development, Engineering, Product, Data, Architecture, and project leadership teams to deliver high-value AI capabilities.
Improve performance, resilience, maintainability, and cost efficiency of deployed AI systems.
Participate in architecture and design reviews, providing thoughtful trade-off analysis and implementation input.
Use modern AI-assisted software engineering tools such as Claude Code, Codex, or equivalent agentic coding platforms as part of day-to-day engineering delivery.
Ability to understand business challenges and translate them into value-add AI solutions leveraging large language models and intelligent automation
Experience designing, building, and maintaining production-grade LLM applications, including end-to-end pipelines from data ingestion through model output delivery (e.g. Azure OpenAI, AWS Bedrock, Google Vertex AI)
Knowledge of embedding models, vector search, and semantic retrieval patterns used to ground LLM outputs in enterprise knowledge sources (e.g. OpenAI Embeddings, Azure AI Search, pgvector etc.)
Ability to build reliable agent loops including failure handling, retries, fallbacks, and context window management across complex multi-step agentic workflows
Ability to debug, troubleshoot, and remediate production LLM and agentic systems including failure diagnosis across retrieval, orchestration, and generation layers
Experience designing and implementing LLM evaluation frameworks covering functional correctness, output quality, safety, and business-defined KPIs (e.g. RAGAS, DeepEval, Arize Phoenix etc.)
Hands-on software engineering proficiency in Python, with the ability to write clean, modular, production-quality code for LLM pipelines and agentic applications
Experience working with structured and unstructured data sets to support LLM application development, including data curation, preparation, and quality validation for model inputs
Familiarity with RESTful and event-driven API patterns including asynchronous workflows, service boundaries, and integration of enterprise data sources to expose LLM and agentic capabilities

Nice-to-haves

Bachelor’s degree preferred.
Master’s degree in Business Administration (MBA) or Science (MS) preferred

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

goaimlllmazureawspythonapidockerkubernetes

Platform: successfactors
Effort: medium

Benefits

Benefits detected in the listing.

Dental

401(K)

Paid Time Off