Job description

About the Role As a Member of Technical Staff focused on AI, you will design applied AI systems and build the products around them across frontend, backend, and data. End-to-end product ownership is central to the role. You will define the problem, decide what to build, ship it, evaluate the result, and maintain it after launch. Most of your technical work will involve LLM-powered applications, agent systems, and the evaluation and reliability systems required to run them in production. The role is full lifecycle Find product-market fit. Start with a small version, test it with users, and decide whether to continue, change direction, or stop. Improve what works. Once a product proves useful, test changes and invest in the versions that perform best. Expand and scale. Grow adoption across WITHIN and with clients, and make the system reliable under increased use. Maintain it. Monitor performance, resolve problems, and continue improving the product. You will set direction with business partners. They provide domain context and user needs; you decide how to scope, sequence, and develop the product. How we work AI-native. We use coding assistants and agent workflows throughout development. Engineers are responsible for testing and reviewing the resulting work. Bias to ship. Engineers work directly with business teams, make product and technical decisions, and release work in small increments. Fast feedback loops, evidence over vibes. We observe how products perform and use feedback and product data to decide what to build next. What we’re looking for How you operate matters more than any specific technology: You have owned products end to end, from an ambiguous initial problem through launch and ongoing operation. You can decide what to test first, define success, and change course when results do not support the current plan. AI tools are already part of how you scope, build, test, and maintain software. You can choose between model behavior, deterministic software, and human review based on the problem. You work independently, communicate tradeoffs, and keep the people involved informed. Technical foundation: Strong Python skills and experience building production systems. Experience building production applications with LLM APIs such as OpenAI, Anthropic, or Vertex AI. Experience building agent workflows that use tools, call external systems, maintain state, and handle multi-step tasks. Experience designing evaluations for LLM-powered systems, including test cases, quality measures, regression testing, and review of production failures. Understanding of context management, token limits, multi-turn conversations, tool calling, structured outputs, prompt design, and common failure modes. Experience integrating external APIs and working with SQL. Experience tracing and debugging behavior across model calls, application code, tools, and external systems. Experience with GCP, AWS, or Azure. Ability to build the product around the AI components, including frontend, backend, and data. Experience with TypeScript, React, and backend services is a plus. Ability to explain technical tradeoffs and work directly with business teams. Strong pluses Multi-agent architectures. Embeddings, vector search, and retrieval-augmented generation. Stateful or sandboxed code execution environments. Human review and approval workflows. Observability, model routing, latency management, and cost control for AI systems. Document automation (Google Docs, Slides, PDFs). Building internal developer tools or productivity platforms. Data warehouses (BigQuery, Snowflake, Databricks), data transformation (dbt), semantic layers (Cube, Looker, dbt Metrics). Our interview process includes, but is not limited to the following: Excel and Typing Test We offer a competitive salary and benefits based on ability level, including: Unlimited vacation policy Monthly Phone Stipend Comprehensive Medical, Dental, and Vision insurance options 401(K) plan with matching Dog friendly office Hybrid work opportunity Professional Development Program Bonus Perk - Seamless allowance Total compensation based on education, experience, and skills level ($90,900-$254,100) Level 1 - Possesses essential capabilities $90,900-$123,540 Level 2 - Possesses developing capabilities $123,540-$156,180 Level 3 - Possesses notable capabilities. $156,180-$188,820 Level 4 - Possesses strong capabilities. $188,820-$221,460 Level 5 - Possesses advanced capabilities. $221,460-$254,100 About WITHIN WITHIN is the world's first Performance Branding company, partnering with some of the biggest brands in the world to drive business growth through innovative marketing strategies. Our integrated operating model collapses the traditional marketing silos between creative and media, performance and brand, and across media channels. With a full suite of offerings including media, creative, SEO, Lifecycle, Retail Media, Affiliate and Influencer, we’re able to work with our brand partners in an integrated fashion, allowing us to align marketing strategies back to core business objectives. Client teams at WITHIN are trained on how to always act as a trusted business partner, acting as a fiduciary to client needs above our own. Teams at WITHIN have the ability to work with iconic brands such as The North Face, Timberland, Ben and Jerry's and Jose Cuervo. Everyone at WITHIN wants to grow and be challenged. It’s a collaborative place made up of small, closely knit and versatile teams that are fast and adaptive to solve problems and build systems. Check out some of our work ! We weave AI into everything we do , using the latest tech across all teams to innovate, work smarter, and make better decisions. Whether it’s in creative, operations, or anything else, AI helps us level up and do things at a whole new scale. We expect our people to use AI in their daily work, fully embracing it as a critical tool to help us succeed. Join Our Network! Stay connected with us and be the first to know about new opportunities, industry insights, and updates. Follow us on: LinkedIn WhatsApp Community I nstagram Tik Tok Locations New York City: 43-01 22nd St, Suite 602, Queens, NY 11101, United States Bogotá: Carrera 14A # 101-47. Bogotá, Distrito Capital de Bogotá 110111, Colombia Mexico City: Av. Insurgentes Sur 1082, Piso (Floor) 2, Oficina 2008, Ciudad de México, CDMX 03100, México AI-Assisted Screening Notice As part of our initial application review process, we may use an AI-assisted tool to help compare skills and job titles from your resume with the requirements of the role. This tool evaluates information based on contextual relevance and is used only to support our manual review process. It is not used to make hiring decisions. If you are a resident of New York City and would like to request an alternative evaluation process or a reasonable accommodation, please contact us at 315-533-2388.

Requirements

Must-haves

Most of your technical work will involve LLM-powered applications, agent systems, and the evaluation and reliability systems required to run them in production.
The role is full lifecycle
Find product-market fit. Start with a small version, test it with users, and decide whether to continue, change direction, or stop.
Improve what works. Once a product proves useful, test changes and invest in the versions that perform best.
Expand and scale. Grow adoption across WITHIN and with clients, and make the system reliable under increased use.
Maintain it. Monitor performance, resolve problems, and continue improving the product.
You will set direction with business partners. They provide domain context and user needs; you decide how to scope, sequence, and develop the product.
AI-native. We use coding assistants and agent workflows throughout development. Engineers are responsible for testing and reviewing the resulting work.
Bias to ship. Engineers work directly with business teams, make product and technical decisions, and release work in small increments.
Fast feedback loops, evidence over vibes. We observe how products perform and use feedback and product data to decide what to build next.
What we’re looking for
How you operate matters more than any specific technology:
You have owned products end to end, from an ambiguous initial problem through launch and ongoing operation.
You can decide what to test first, define success, and change course when results do not support the current plan.
AI tools are already part of how you scope, build, test, and maintain software.
You can choose between model behavior, deterministic software, and human review based on the problem.
You work independently, communicate tradeoffs, and keep the people involved informed.
Strong Python skills and experience building production systems.
Experience building production applications with LLM APIs such as OpenAI, Anthropic, or Vertex AI.
Experience building agent workflows that use tools, call external systems, maintain state, and handle multi-step tasks.
Experience designing evaluations for LLM-powered systems, including test cases, quality measures, regression testing, and review of production failures.
Understanding of context management, token limits, multi-turn conversations, tool calling, structured outputs, prompt design, and common failure modes.

Nice-to-haves

Ability to build the product around the AI components, including frontend, backend, and data. Experience with TypeScript, React, and backend services is a plus.
Bonus Perk - Seamless allowance

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aillmpythonsqlgcpawsazuretypescriptreact

Platform: greenhouse
Effort: quick

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Professional Development