Job description

HARNESS ENGINEER Location: San Francisco (in-person, in-office, full-time ONLY) Compensation: $150K-$250K base + meaningful equity ABOUT VIRIO Virio is building the next-generation B2B GTM stack. Backed by investors and operators from LinkedIn, YouTube, HubSpot, Rippling, and Google, we turn executive-led content into revenue for the fastest-growing B2B companies. We're building content engines to help B2B companies turn LinkedIn into their number one channel. Virio is solving an unsolved problem: how do you write perfect content? The best human strategist researches the space, finds the angle, and knows your goals and constraints, but they're capped by the hours in a day and one human career's worth of expertise. An agent isn't. Crafting "perfect" content has three components: - Research: to identify and collect the best inputs - Synthesis: to devise the strategy and execute on it - Verification: RL verification of content quality and efficacy The team is almost 100% ex-founders and VCs from Yale, UC Berkeley, Stripe, and more. And we've consecutively added $1M ARR/mo because everyone and their co-founder wants what we're selling. This problem doesn't have a playbook. We're looking for a Harness Engineer to obsess over AI-for-writing and own that layer end to end: the data feedback loop, evals, and harness design that turn a subjective judgment into something we can measure and improve, so day by day, we can get ever closer to solving content. WHAT YOU'LL DO As a Harness Engineer, you'll own the intelligence layer that sits between our AI models and product: the system prompts, tool definitions, context management, and evaluation framework that makes agents actually work in production. Specifically: - Build and refine the system prompts, tool integrations, and context windows that shape how our models behave across our platform, and you'll see how small prompt tweaks cascade into measurable product impact. (Nice to have: background in English, literature, creative writing, or humanities) - Design the evaluation framework (LLM-as-judge evals, deterministic tests, production monitoring) that lets us ship with confidence. You'll define what success looks like and build the metrics to measure it. - Architect the abstraction layer between our product (file systems, artifacts, skills) and the model's capabilities, making complex multi-step workflows feel natural to the model and reliable to users. - Own prompt versioning, experimentation, and iteration. You'll A/B test prompt variations, measure their impact on agent quality, and ship improvements across our production system. - Collaborate with product and engineering to identify signal: where our agents are failing, where users are stuck, and translate that into prompt and architecture improvements. WHAT SUCCESS LOOKS LIKE - After 30 days: You understand our agent stack: the system prompts, available tools, context window strategy, and current failure modes. You've shipped your first prompt improvement and measured its impact. - After 90 days: You've designed and implemented our core evaluation framework. Our team uses it as the source of truth for agent quality. You've shipped 2-3 meaningful prompt iterations that improved measurable outputs, and you're comfortable making architecture trade-offs. - After 6 months: You own the harness layer end-to-end. You've architected improvements that reduced hallucination, improved context retention, or increased model reliability. You're driving architectural decisions about how we expose capabilities to the product team. You're writing technical content about how we've solved these problems, attracting the next generation of harness engineers to the company. TRAITS THAT THRIVE AT VIRIO - High agency and self-direction: acts without waiting for requirements or detailed instructions. - Small-team intensity comfort: comfortable working intensely and closely with a small, high-output team. - Unorthodox problem solving: sees non-obvious paths forward and challenges conventional approaches. - Quality-driven execution: detail-oriented with high standards for correctness and quality. - Low ego and accountability: takes full ownership and accountability for outcomes. BENEFITS - Work directly with the founders - Meaningful equity as part of the founding team - 100 percent paid medical, dental, and vision - 401(k) plan - $1k monthly wellness and meals stipend - Relocation support for San Francisco - Company-wide annual off-sites - High ownership, high trust, fast progression - In-person culture with a deep commitment to excellence This is a full-time, on-site role based in San Francisco. 6 days in the office.

Requirements

Must-haves

Location: San Francisco (in-person, in-office, full-time ONLY)
Compensation: $150K-$250K base + meaningful equity
Research: to identify and collect the best inputs
Synthesis: to devise the strategy and execute on it
Verification: RL verification of content quality and efficacy
The team is almost 100% ex-founders and VCs from Yale, UC Berkeley, Stripe, and more. And we've consecutively added $1M ARR/mo because everyone and their co-founder wants what we're selling.
Design the evaluation framework (LLM-as-judge evals, deterministic tests, production monitoring) that lets us ship with confidence. You'll define what success looks like and build the metrics to measure it.
Architect the abstraction layer between our product (file systems, artifacts, skills) and the model's capabilities, making complex multi-step workflows feel natural to the model and reliable to users.
Own prompt versioning, experimentation, and iteration. You'll A/B test prompt variations, measure their impact on agent quality, and ship improvements across our production system.
Collaborate with product and engineering to identify signal: where our agents are failing, where users are stuck, and translate that into prompt and architecture improvements.
After 30 days: You understand our agent stack: the system prompts, available tools, context window strategy, and current failure modes. You've shipped your first prompt improvement and measured its impact.
High agency and self-direction: acts without waiting for requirements or detailed instructions.
Small-team intensity comfort: comfortable working intensely and closely with a small, high-output team.
Unorthodox problem solving: sees non-obvious paths forward and challenges conventional approaches.
Quality-driven execution: detail-oriented with high standards for correctness and quality.
Low ego and accountability: takes full ownership and accountability for outcomes.

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aillm

Platform: ashby
Effort: quick

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Wellness