Yahoo is seeking a Staff AI Operations Builder (IC5) to architect the AI-native operating engine for Yahoo Mail. This role involves transforming Yahoo Mail from a traditional product and operating organization into an AI-native one.

Company: Yahoo

Role: Staff AI Operations Engineer / Builder

Location: United States of America

Experience:

8+ years of software engineering, product management, technical systems-building, or platform architecture experience
Professional experience designing, implementing, and evaluating LLM-backed applications, multi-agent frameworks, RAG architectures, or automated internal operations systems
High-agency ownership with a proven track record of delivering architectural strategy and shipping complex, operational platforms in highly ambiguous environments

Key Skills:

Python
TypeScript
React
Node.js
relational/non-relational data systems
AWS Bedrock
Vertex AI
modern coding assistants (e.g., Cursor, Claude Code)

Qualification:

8+ years of software engineering, product management, technical systems-building, or platform architecture experience
Professional experience designing, implementing, and evaluating LLM-backed applications, multi-agent frameworks, RAG architectures, or automated internal operations systems
Deep familiarity with production-grade AI development platforms (e.g., AWS Bedrock, Vertex AI) and modern coding assistants (e.g., Cursor, Claude Code)

Role Focus:

Architect and deploy full-stack internal AI products
Define foundational engineering patterns, guardrails, and platform architectures for reliability, data permissions, enterprise privacy, and observability
Establish automated LLM evaluation (Evals), output validation frameworks, and human-in-the-loop validation flows
Incorporate state-of-the-art developer frameworks to abstract operational workflows into reusable API layers
Design, deploy, and continuously optimize multi-agent orchestrations and retrieval-augmented generation (RAG) pipelines

Additional responsibilities:

Collaborate horizontally with Product, Engineering, Design, and Executive leadership to map physical organizational processes into autonomous workflows
Mentor and uplevel adjacent engineering, product, and operational squads on prompt engineering, structured LLM interactions, and automated workflow adoption
Turn highly ambiguous, fragmented data sources into structured, queryable knowledge networks

Nice to have:

Experience deploying and tuning open-source agentic frameworks or managing large-scale internal copilot environments
Experience in Product Operations, Business Operations, Strategy, or Technical Program Management within high-scale consumer tech organizations
Strong background in cloud infrastructure, data pipelining (SQL, ETL processes), and secure enterprise access control management

Other:

Flexible hybrid work options
Comprehensive benefits including healthcare, 401k, backup childcare, education stipends, and more
Compensation ranges from $143,625.00 - $299,375.00/yr
Equal opportunity workplace with a commitment to diversity and inclusion

Staff AI Operations Engineer / Builder

Skills Required

Description