Director of AIML Engineering at ELLKAY

Job description

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies. Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world. ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy. Job Description: ELLKAY is seeking a highly technical Director of AI/ML Engineering to lead, scale, and mentor a top-tier team of Staff AI Systems Integration Engineers and MLOps/GenAIOps Engineers. In this role, you will own the technical architecture, execution, and operational performance of enterprise-grade, autonomous Agentic AI systems, LLM workflows, and core machine learning platforms. As a technical leader with high-fidelity thinking, you will bridge the gap between complex engineering execution and strategic vision. You will partner closely with Product Management to define product scope, translate business goals into scalable technical strategies, and build robust, end-to-end solutions that operate seamlessly within production healthcare ecosystems. East Coast individuals preferred. Essential Duties & Responsibilities: Strategic Product Alignment & Scope Definition • Partner directly with Product Management and executive leadership to define product scope, multi-agent capabilities, and technical roadmaps. • Translate broad, complex business and product requirements into clear technical designs, multi-agent orchestration architectures, and actionable engineering milestones. • Drive high-fidelity problem-solving to evaluate build-vs-buy decisions, foundational model selections, tool-calling strategies, and infrastructure investments. 2. Technical Leadership & System Architecture • Oversee the end-to-end implementation of multi-agent coordination frameworks (e.g., Bedrock Agents, LangGraph, AutoGen), agentic state persistence layers, and tool-use pipelines. • Provide architectural oversight across real-time and event-driven data pipelines, REST/gRPC microservices, AWS CDK constructs, and healthcare data integration standards (FHIR R4, HL7 v2, USCDI). • Champion rigorous engineering standards across the team for code quality, system integration, agent execution trajectories, unit/integration testing, and deployment hygiene. 3. MLOps, GenAIOps & Infrastructure Governance • Oversee the operational lifecycle of AI/ML models and autonomous agents, including automated retraining pipelines, prompt/agent versioning, vector index versioning, and continuous evaluation (LLM-as-a-Judge, held-out test sets). • Enforce robust AgentOps and observability practices using trajectory tracking, token/cost monitoring, execution latency tracking, and guardrail performance metrics. • Ensure all AI/ML architectures and agent runtimes comply with strict regulatory frameworks, including HIPAA, PHI/PII redaction, least-privilege tool execution controls, and zero-leakage data governance. 4. Team Building & Context Switching • Lead, mentor, and expand a high-performing engineering organization, fostering a culture of technical excellence, accountability, and continuous learning. • Seamlessly operate across multiple technical contexts—from low-level container engineering, AWS infrastructure, and model fine-tuning to high-level multi-agent workflow engines and business strategy. • Serve as the primary technical interface and bridge between AI Engineers, MLOps Engineers, Platform Infrastructure, Product, Security, and Enterprise Leadership. Qualifications: • 12+ years of total software engineering and machine learning experience, with at least 4+ years in engineering leadership (Director, Senior Engineering Manager, or Principal Lead) managing high-performing AI/ML engineering teams. • Deep Agentic AI & LLM Systems Expertise: Hands-on experience designing and operating production-grade agentic workflows, dynamic tool/function-calling, multi-agent frameworks (LangGraph, AutoGen, CrewAI, Bedrock Agents), and state persistence engines. • Strong MLOps / GenAIOps Foundation: Direct experience overseeing model/agent lifecycle automation, including AWS SageMaker (Pipelines, Model Registry, Model Monitor), prompt/agent versioning, synthetic evaluations, and trajectory observability tools (LangSmith, Arize, Phoenix, CloudWatch). • Cloud Architecture & Systems Engineering: Expert-level knowledge of distributed systems, cloud-native AWS architectures (ECS Fargate, Lambda, Step Functions, EventBridge, DynamoDB, S3), Infrastructure as Code (AWS CDK in Python/TypeScript), and container execution (Docker, ECR). • AI Development: Direct experience building custom AI dev tooling, internal CLI agents, or custom LLM-based developer productivity tools such as Claude Code/Codex. • Exceptional Communication Skills: Proven ability to articulate complex technical architectures, risks, and trade-offs clearly to executive stakeholders, cross-functional partners, and external technical teams. Preferred Qualifications • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Electrical Engineering, or a related quantitative technical field. • Experience implementing human-in-the-loop (HITL) intervention protocols, self-correction/reflection loops, and safety guardrails for autonomous agents in mission-critical production environments. Benefits: ELLKAY offers a comprehensive and competitive benefit package that starts day one! Including: • Medical, Dental, and Vision benefits • Employer-paid Life and LTD • 401k w/ matching – once eligibility is met • Work/life balance • Paid Volunteer Program • Flexible working hours • Generous FTO • Remote work options • Employee Discounts • Parental Leave • Gym membership / Exercise class stipends Our awesome culture includes: • Working with talented, collaborative, and friendly people who love what they do • Professional growth within • Innovation environment • On site in HQ Free daily lunches Awards: • 2025 Top Workplaces Employee Appreciation • 2025 Top Workplaces Employee Well-Being • 2025 Top Workplaces Professional Development • 2025 Top Workplaces Leadership • 2026 USA Today Top Workplaces • 2026 NJ Top Workplaces Additional information At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets. For more information on our company, visit www.ELLKAY.com. ELLKAY LLC is a Smoke-Free Workplace. ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Compensation range: $200,000 - $230,000

Requirements

Must-haves

Strategic Product Alignment & Scope Definition
Partner directly with Product Management and executive leadership to define product scope, multi-agent capabilities, and technical roadmaps.
Translate broad, complex business and product requirements into clear technical designs, multi-agent orchestration architectures, and actionable engineering milestones.
Drive high-fidelity problem-solving to evaluate build-vs-buy decisions, foundational model selections, tool-calling strategies, and infrastructure investments.
Technical Leadership & System Architecture
Oversee the end-to-end implementation of multi-agent coordination frameworks (e.g., Bedrock Agents, LangGraph, AutoGen), agentic state persistence layers, and tool-use pipelines.
Provide architectural oversight across real-time and event-driven data pipelines, REST/gRPC microservices, AWS CDK constructs, and healthcare data integration standards (FHIR R4, HL7 v2, USCDI).
Champion rigorous engineering standards across the team for code quality, system integration, agent execution trajectories, unit/integration testing, and deployment hygiene.
MLOps, GenAIOps & Infrastructure Governance
Enforce robust AgentOps and observability practices using trajectory tracking, token/cost monitoring, execution latency tracking, and guardrail performance metrics.
Ensure all AI/ML architectures and agent runtimes comply with strict regulatory frameworks, including HIPAA, PHI/PII redaction, least-privilege tool execution controls, and zero-leakage data governance.
Team Building & Context Switching
Lead, mentor, and expand a high-performing engineering organization, fostering a culture of technical excellence, accountability, and continuous learning.
Seamlessly operate across multiple technical contexts—from low-level container engineering, AWS infrastructure, and model fine-tuning to high-level multi-agent workflow engines and business strategy.
Serve as the primary technical interface and bridge between AI Engineers, MLOps Engineers, Platform Infrastructure, Product, Security, and Enterprise Leadership.
AI Development: Direct experience building custom AI dev tooling, internal CLI agents, or custom LLM-based developer productivity tools such as Claude Code/Codex.
Exceptional Communication Skills: Proven ability to articulate complex technical architectures, risks, and trade-offs clearly to executive stakeholders, cross-functional partners, and external technical teams.
Employer-paid Life and LTD
Work/life balance
Paid Volunteer Program
Flexible working hours

Nice-to-haves

East Coast individuals preferred.
Bachelor’s or Master’s degree in Computer Science, Machine Learning, Electrical Engineering, or a related quantitative technical field.
Experience implementing human-in-the-loop (HITL) intervention protocols, self-correction/reflection loops, and safety guardrails for autonomous agents in mission-critical production environments.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlllmmachine learningrestawspythontypescriptdocker

Platform: adp-workforce-now
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401k

Parental Leave

Professional Development