Senior AI Engineer at Crexi

Job description

About Crexi Commercial real estate is one of the largest asset classes on earth and one of the last to go digital. Deals still get done over email threads, PDFs, and relationships nobody can search for. Crexi is the exchange betting that doesn't have to be true anymore: we're building the platform where an entire industry finds, evaluates, and closes deals, and we're betting hard on AI to get there faster than anyone thought this industry could move. There's no playbook for turning a trillion-dollar, relationship-driven industry into a modern marketplace which means the people building it get to write it. About the Role: The AI Engineer builds the agentic AI systems that power Crexi's platform, including orchestration, retrieval, and action layers grounded in Crexi's proprietary commercial real estate data. The role builds multi-step agentic workflows that understand user intent, orchestrate the right capabilities, and complete real work, not just answer questions, using tools like LangGraph and AWS Bedrock AgentCore . It exists to extend Crexi's AI-powered research, document generation, and zoning intelligence into unified, trustworthy agentic experiences for brokers, appraisers, lenders, and investors. What You'll Do: A typical day may include: Design and implement multi-step agentic workflows, including routing, planning, tool use, and state management, using frameworks like LangGraph/LangChain to move from user intent to real, completed actions. Build evaluation frameworks and production monitoring (offline evals, human-in-the-loop annotation) to measure quality, reliability, and business outcomes, not just model metrics. Build context and retrieval pipelines over Crexi's proprietary CRE data, handling the compound, qualitative queries that structured filters can't answer. Work primarily with Anthropic frontier models on AWS Bedrock, using Bedrock AgentCore for agent runtime, identity, and memory, and helps evaluate open-weight alternatives on cost, latency, and capability. Implement guardrails, structured outputs, and graceful ambiguity handling so agentic systems ask for clarification rather than acting on unclear intent, and establishes trace-level observability across LLM calls and tool invocations. Leverage agentic coding tools (e.g., Claude Code, Codex) for scaffolding, refactoring, test generation, and debugging, while critically reviewing AI-generated output for correctness, security, and performance. Rapidly prototype against real user feedback, partnering with Product and Design, and helps convert successful prototypes into scalable, reusable capabilities. Ensure AI outputs are explainable, source-linked, and trustworthy enough to inform real business decisions. Qualifications: 5+ years of professional software development experience in production environments with meaningful scope/ownership, including 2+ years hands-on building LLM-powered applications in production. Real experience with agentic architectures (multi-step pipelines, tool/function calling, state machines, memory), ideally with LangGraph or similar orchestration frameworks. Strong retrieval design skills: RAG systems, embeddings, vector search, and the judgment to know when retrieval is the problem and when the data is. Strong Python proficiency and real-world experience building backend services and APIs in production. Experience with cloud infrastructure (AWS preferred) and modern collaborative workflows (GitHub/GitLab, code reviews, CI/CD). Demonstrated use of agentic coding tools (e.g., Claude Code, Codex) in a professional workflow, without compromising quality. Comfortable operating in ambiguity and fast iteration cycles; experience designing LLM evaluation pipelines (offline evals, production monitoring, human-in-the-loop annotation) is a plus. Bachelor’s degree in Computer Science or related field, or equivalent practical experience. Who You Are: Thrives in a fast-paced, dynamic environment. Exceptional communication skills, with the ability to provide clear and concise information to stakeholders at all levels of the organization. Strong analytical skills, with the ability to interpret complex information, identify patterns, and present insights clearly and accurately. Excellent organizational and prioritization skills, with the ability to manage multiple priorities and deadlines simultaneously. Self-starter who independently owns their own success and demonstrates strong initiative. Responsive, action-oriented, and proactive in identifying and resolving issues. Strong problem-solving and creative thinking skills, with the ability to evaluate options and implement effective solutions. Effective collaborator and team player, with the ability to work cross-functionally and build strong working relationships. Demonstrated ability to handle sensitive and confidential information with the utmost professionalism and discretion. Why Crexi? Real impact, fast. Join a rapidly scaling startup where your work moves the needle from day one. Real ownership. Equity in Crexi's growth story. Built for growth. A flexible team structure designed for real career discretion. Time that is yours. Discretionary PTO - take what you need, when you need it. Health & Future covered. Medical, dental, and vision insurance, 401(k), FSA/HSA options, and Life & AD&D insurance. Set up right. Home-office reimbursement for remote employees. A winning team. A collaborative culture with team activities that bring people together. The anticipated base salary range for candidates who will work in our Playa Vista, California location is $179,000 to $241,000. The final salary offered to a successful candidate will depend on several factors, which may include, but are not limited to, the type and length of experience applicable to the role and within the industry, education, geographic location, etc. Commercial Real Estate Exchange, Inc (“Crexi”) is a multi-state employer, and this salary range may not reflect positions that work in other states. Crexi is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Crexi will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Requirements

Must-haves

Design and implement multi-step agentic workflows, including routing, planning, tool use, and state management, using frameworks like LangGraph/LangChain to move from user intent to real, completed actions.
Build evaluation frameworks and production monitoring (offline evals, human-in-the-loop annotation) to measure quality, reliability, and business outcomes, not just model metrics.
Build context and retrieval pipelines over Crexi's proprietary CRE data, handling the compound, qualitative queries that structured filters can't answer.
Work primarily with Anthropic frontier models on AWS Bedrock, using Bedrock AgentCore for agent runtime, identity, and memory, and helps evaluate open-weight alternatives on cost, latency, and capability.
Leverage agentic coding tools (e.g., Claude Code, Codex) for scaffolding, refactoring, test generation, and debugging, while critically reviewing AI-generated output for correctness, security, and performance.
Rapidly prototype against real user feedback, partnering with Product and Design, and helps convert successful prototypes into scalable, reusable capabilities.
Ensure AI outputs are explainable, source-linked, and trustworthy enough to inform real business decisions.
5+ years of professional software development experience in production environments with meaningful scope/ownership, including 2+ years hands-on building LLM-powered applications in production.
Real experience with agentic architectures (multi-step pipelines, tool/function calling, state machines, memory), ideally with LangGraph or similar orchestration frameworks.
Strong retrieval design skills: RAG systems, embeddings, vector search, and the judgment to know when retrieval is the problem and when the data is.
Strong Python proficiency and real-world experience building backend services and APIs in production.
Demonstrated use of agentic coding tools (e.g., Claude Code, Codex) in a professional workflow, without compromising quality.
Bachelor’s degree in Computer Science or related field, or equivalent practical experience.
Thrives in a fast-paced, dynamic environment.
Exceptional communication skills, with the ability to provide clear and concise information to stakeholders at all levels of the organization.
Strong analytical skills, with the ability to interpret complex information, identify patterns, and present insights clearly and accurately.
Excellent organizational and prioritization skills, with the ability to manage multiple priorities and deadlines simultaneously.
Self-starter who independently owns their own success and demonstrates strong initiative.
Responsive, action-oriented, and proactive in identifying and resolving issues.
Strong problem-solving and creative thinking skills, with the ability to evaluate options and implement effective solutions.
Effective collaborator and team player, with the ability to work cross-functionally and build strong working relationships.
Demonstrated ability to handle sensitive and confidential information with the utmost professionalism and discretion.

Nice-to-haves

Experience with cloud infrastructure (AWS preferred) and modern collaborative workflows (GitHub/GitLab, code reviews, CI/CD).
Comfortable operating in ambiguity and fast iteration cycles; experience designing LLM evaluation pipelines (offline evals, production monitoring, human-in-the-loop annotation) is a plus.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

goaiawsllmpythonci/cd

Platform: greenhouse
Effort: quick

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Pto