We are looking for a Senior Software Engineer to help build NeMo Platform, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role will focus on NeMo Evaluator, which helps teams understand whether changes to AI agents are making those agents better.

Company: NVIDIA

Role: Senior Software Engineer, Agentic Systems

Location: US, CA, Santa Clara; US, NY, Remote; US, CO, Remote; US, WA, Remote; US, MA, Remote

Experience:

5+ years of professional software engineering experience building production systems
BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field

Key Skills:

Python engineering
API design
typing
testing
debugging
performance analysis
maintainable software design
SDKs
libraries
plugins
CLIs
distributed systems
cloud-native services
containers
Kubernetes
job orchestration
structured data modeling
validation systems
Pydantic
typed schemas
event/trace models
SDK-generated types

Qualification:

BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field

Role Focus:

Design and implement Python-first APIs, SDK workflows, and plugin interfaces for building, measuring, and improving agents across multiple runtimes and product surfaces
Build reusable systems for observing behavior, measuring progress, detecting regressions, and turning runtime evidence into product decisions
Build systems for ingesting, normalizing, validating, and analyzing agent execution data and evaluation datasets
Partner with research, product, platform, and infrastructure teams to integrate agentic capabilities broadly across NVIDIA agent runtimes and developer workflows
Help turn emerging agent development and improvement techniques into reliable, reusable product capabilities
Improve reliability, observability, debuggability, and performance across NeMoStack services, SDKs, plugins, jobs, and developer workflows
Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows
Drive 'speed of light' engineering: fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints
Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems

Nice to have:

Experience building, deploying, and iterating on production agentic AI systems where evaluation was used to measure and improve real product outcomes
Experience designing evaluation workflows for heterogeneous agents, including tool-using agents, RAG agents, workflow agents, coding agents, or long-running autonomous systems
Experience integrating evaluation capabilities across multiple products, runtimes, or internal platforms, especially through Python SDKs, plugins, or shared developer tooling
Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency
Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment

Other:

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until June 7, 2026.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.

Senior Software Engineer, Agentic Systems

Skills Required

Description