Job description

ABOUT PLENFUL Plenful is on a mission to transform healthcare operations from the inside out. Fresh off our $50M Series B and backed by Notable Capital, Bessemer Venture Partners, TQ Ventures, Susa/Kivu Ventures, and other leading investors, we’re building the category-defining AI automation platform that healthcare teams rely on to operate smarter, faster, and more efficiently. Our technology empowers healthcare operators across hospital and health systems, pharmacies and payors to eliminate manual work, reduce administrative burden, and improve compliance, all while unlocking critical revenue to fund programs for their in-need patient populations. Built by healthcare operators for healthcare operators, Plenful is driven by a deep understanding of the challenges facing today’s care teams. We’re passionate about equipping healthcare workers with world-class tools that deliver real, measurable impact, and we’re proud to serve 100+ leading health systems, pharmacies, and healthcare organizations across the country. If you’re excited to help shape the future of healthcare, we’d love to meet you. Apply now to join our growing team. ABOUT THE ROLE Healthcare's back office still runs on faxes, PDFs and phone calls. AI can take that work off people's plates, but only if it is accurate enough to trust with patient and financial data. At Plenful, we build agents and models that do that work in production, with people in the loop wherever judgment matters. As a Senior Machine Learning Engineer, you own the pieces that make those systems reliable: the agents, the models behind them, and the data and evaluation loop that improves both every week. WHAT YOU'LL DO YOU SHIP AGENTS THAT DO REAL WORK - Design, build and run production agents that use tools, retrieval and multi-step reasoning to finish healthcare workflows end to end. - Build the orchestration, tracing and failure recovery that keep agents dependable when inputs are messy. - Decide when a problem needs an agent, a model or a deterministic rule, and route low-confidence cases to a person. YOU MAKE MODELS BETTER, NOT JUST CALL THEM - Fine-tune and post-train LLMs and vision-language models on healthcare tasks, using methods like supervised fine-tuning, preference optimization and distillation. - Choose between prompting, retrieval and fine-tuning for each problem, and prove the choice with data. - Balance quality, latency and cost when you serve models. YOU OWN THE LOOP THAT MAKES IT ALL IMPROVE - Build and version datasets: labeled sets, golden sets and synthetic data drawn from production signal. - Write evals that catch regressions before customers do: automated graders, LLM-as-judge calibrated against human labels, and regression suites that run in CI. - Instrument production with tracing, drift detection and failure taxonomies, then feed what you learn back into training data. - Keep releases reproducible with solid MLOps: Docker, Kubernetes, MLflow or equivalent, and CI/CD. YOU HANDLE PATIENT DATA WITH CARE - Use the minimum data necessary, and de-identified or synthetic data wherever it does the job. - Follow HIPAA and Plenful's security and AI usage practices in how you build, test and log. WHAT WE'RE LOOKING FOR - 5+ years building and shipping software or ML systems, including 2+ years with LLM-based systems in production. - Strong Python, plus PyTorch and Hugging Face Transformers. - Hands-on agent experience with a framework like LangGraph, and with RAG and vector search (for example Pinecone). - You have fine-tuned an LLM or VLM and can explain what improved and how you measured it. - You have built an evaluation harness and know why accuracy alone misleads and how to calibrate an LLM judge. - Comfort with large-scale datasets, databases and data pipelines. - Experience with traditional ML, and the judgment to know when a simpler model beats an LLM. YOU STAY CURRENT, AND YOU CAN SHOW IT - You use the newest models and coding agents every week, form opinions, and test them on real problems. - You go from idea to working prototype in hours, then bring back what works. - You have proof: shipped projects, open source, write-ups or your own evals of new releases. NICE TO HAVE - Healthcare data experience: EHR, FHIR, claims, prior authorization. - Document AI or vision model experience. - Serving and training at scale with tools like vLLM, FSDP or DeepSpeed. - Work in another regulated, high-stakes domain. WHAT YOUR FIRST 90 DAYS LOOK LIKE By day 30, you have shipped a change to a production agent or model. By day 90, you own the eval suite and improvement loop for one workflow, and its quality numbers are moving. WHY YOU'LL LOVE WORKING HERE - 🚀 Mission-Driven, World-Class Team — Join an exceptional group of professionals aligned around a meaningful mission and committed to making an impact - 📈 Opportunities for Growth — Strengthen your expertise through collaboration with experienced, high-performing leaders across the organization - 🏢 Flexible Hybrid Work Environment — We're remote-first, with meaningful office presence in San Francisco and New York. R&D roles follow a hybrid model, with two days per week in our San Francisco office BENEFITS & PERKS - 🏥 Healthcare Coverage — Full medical, dental, and vision insurance for you and participation for your family - 💰 401(k) with Company Match — Plenful matches 50% of your first 3% contributed - 📊 Equity — Every full-time employee shares in our success - 🌴 Unlimited PTO — Take the time you need, when you need it - 🍽️ Daily Lunch Stipend — $100/week to cover your midday meals - 💪 Wellness Stipend — $100/month to support your health and well-being - 🚇 Commuter Benefits — $100/month for SF and NYC-based employees - 👶 Parental Leave — Paid leave to support growing families

Requirements

Must-haves

Healthcare's back office still runs on faxes, PDFs and phone calls. AI can take that work off people's plates, but only if it is accurate enough to trust with patient and financial data.
Design, build and run production agents that use tools, retrieval and multi-step reasoning to finish healthcare workflows end to end.
Build the orchestration, tracing and failure recovery that keep agents dependable when inputs are messy.
Decide when a problem needs an agent, a model or a deterministic rule, and route low-confidence cases to a person.
YOU MAKE MODELS BETTER, NOT JUST CALL THEM
Fine-tune and post-train LLMs and vision-language models on healthcare tasks, using methods like supervised fine-tuning, preference optimization and distillation.
Choose between prompting, retrieval and fine-tuning for each problem, and prove the choice with data.
Balance quality, latency and cost when you serve models.
YOU OWN THE LOOP THAT MAKES IT ALL IMPROVE
Build and version datasets: labeled sets, golden sets and synthetic data drawn from production signal.
Write evals that catch regressions before customers do: automated graders, LLM-as-judge calibrated against human labels, and regression suites that run in CI.
Instrument production with tracing, drift detection and failure taxonomies, then feed what you learn back into training data.
Keep releases reproducible with solid MLOps: Docker, Kubernetes, MLflow or equivalent, and CI/CD.
Use the minimum data necessary, and de-identified or synthetic data wherever it does the job.
Follow HIPAA and Plenful's security and AI usage practices in how you build, test and log.
5+ years building and shipping software or ML systems, including 2+ years with LLM-based systems in production.
Strong Python, plus PyTorch and Hugging Face Transformers.
Hands-on agent experience with a framework like LangGraph, and with RAG and vector search (for example Pinecone).
You have fine-tuned an LLM or VLM and can explain what improved and how you measured it.
You have built an evaluation harness and know why accuracy alone misleads and how to calibrate an LLM judge.

Nice-to-haves

Healthcare data experience: EHR, FHIR, claims, prior authorization.
Document AI or vision model experience.
Serving and training at scale with tools like vLLM, FSDP or DeepSpeed.
Work in another regulated, high-stakes domain.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimachine learningllmdockerkubernetesci/cdmlpythongo

Platform: ashby
Effort: quick

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Pto

Parental Leave

Wellness