Job description

Senior / Staff Forward Deployed Engineer AI Data & Evaluation Fully Remote About the Role We're looking for a senior engineer to turn loosely defined customer needs into production-grade data, evaluation and ML-assisted workflows for advanced AI systems. You'll own the full lifecycle of AI data pipelines: building and deploying the ML-based tooling that makes human-in-the-loop data generation and review faster, more reliable and higher quality. The role sits where data science, data engineering, AI engineering and delivery operations meet. You'll work closely with delivery and operations teams and with customer technical stakeholders. You'll write technical specifications, design evaluation workflows, set quality standards and build the applications that keep projects moving. This role suits someone who is comfortable across the whole delivery lifecycle, likes solving messy multi-part problems hands-on, communicates clearly to technical and non-technical audiences, and works well on a team. What You'll Do Project Execution and Delivery • Build and deploy evaluators, and design quality measurement systems that validate outputs and confirm deliverables meet customer expectations • Generate synthetic datasets by developing new pipelines or adapting existing ones, to speed up engagements and augment training data • Package and deliver production-grade datasets with standardized formatting, thorough documentation and quality assurance • Build custom applications and tooling for non-standard or specialized customer requirements Production and Technical Partnership • Define production specifications and workflows, and secure technical alignment with customer teams for smooth go-live transitions • Act as the technical point of contact for delivery leads, answering complex questions, resolving blockers and supporting customer discussions • Keep specifications consistent across customer and internal teams throughout each engagement • Document best practices and spot automation opportunities, working with engineering to keep improving delivery Technical Leadership and Innovation • Run model benchmarking on existing datasets and maintain solution leaderboards that show technical capability • Keep improving evaluation frameworks, technical assets and delivery processes to raise speed, quality and scale What We're Looking For • 5+ years in data science, data engineering, ML engineering, solutions engineering, forward-deployed engineering or similar technical roles • Strong hands-on experience with Python and SQL data tooling • Familiarity with ML and LLM-based solutions, including applying ML in production and building validation, evaluation or quality measurement workflows for ML/LLM systems • A track record of turning ambiguous requirements into technical specifications, workflows and delivered solutions • Experience integrating systems through APIs and building custom tooling for non-standard needs Why This Role You'll work on projects that shape real production AI systems, creating the training and evaluation data behind the next generation of large language models and AI agents. You'll own technical data workflows end to end and help shape how the delivery team works as it grows. Marathon TS is committed to the development of a creative, diverse and inclusive work environment. In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Marathon TS will be based on merit, qualifications, and abilities. Marathon TS does not discriminate against any person because of race, color, creed, religion, sex, national origin, disability, age or any other characteristic protected by law (referred to as "protected status ").

Requirements

Must-haves

Senior / Staff Forward Deployed Engineer
AI Data & Evaluation
Fully Remote
This role suits someone who is comfortable across the whole delivery lifecycle, likes solving messy multi-part problems hands-on, communicates clearly to technical and non-technical audiences, and works well on a team.
Project Execution and Delivery
Build and deploy evaluators, and design quality measurement systems that validate outputs and confirm deliverables meet customer expectations
Generate synthetic datasets by developing new pipelines or adapting existing ones, to speed up engagements and augment training data
Package and deliver production-grade datasets with standardized formatting, thorough documentation and quality assurance
Build custom applications and tooling for non-standard or specialized customer requirements
Production and Technical Partnership
Define production specifications and workflows, and secure technical alignment with customer teams for smooth go-live transitions
Act as the technical point of contact for delivery leads, answering complex questions, resolving blockers and supporting customer discussions
Keep specifications consistent across customer and internal teams throughout each engagement
Document best practices and spot automation opportunities, working with engineering to keep improving delivery
Technical Leadership and Innovation
Run model benchmarking on existing datasets and maintain solution leaderboards that show technical capability
Keep improving evaluation frameworks, technical assets and delivery processes to raise speed, quality and scale
5+ years in data science, data engineering, ML engineering, solutions engineering, forward-deployed engineering or similar technical roles
Strong hands-on experience with Python and SQL data tooling
Familiarity with ML and LLM-based solutions, including applying ML in production and building validation, evaluation or quality measurement workflows for ML/LLM systems
A track record of turning ambiguous requirements into technical specifications, workflows and delivered solutions
Experience integrating systems through APIs and building custom tooling for non-standard needs
Why This Role

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlgopythonsqlllm

Platform: jobdiva
Effort: medium