Building the Future of Crypto. Kraken is a mission-focused company rooted in crypto values, seeking to accelerate the global adoption of crypto for financial freedom and inclusion.

Company: Kraken

Role: Senior Software Engineer – AI Infrastructure

Location: Remote

Experience:

5+ years of experience building and operating high-scale production systems
Experience operating services serving millions of users or high-throughput workloads
Experience designing observability, monitoring, and failure recovery systems

Key Skills:

Rust
systems-level programming
distributed systems
reliability engineering
performance optimization
ML infrastructure
model serving
MLOps

Role Focus: • Design and build the infrastructure layer powering AI agent systems in production • Develop high-performance Rust services that handle model inference, orchestration, and execution • Architect scalable systems capable of supporting millions of users and high request throughput • Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring • Define guardrails, observability, and failure handling for agent-driven workflows • Optimize latency, throughput, and cost across inference and orchestration layers • Partner closely with the Agent Systems team to translate experimental prototypes into hardened production systems

Nice to have:

Experience building infrastructure for agent-based or LLM-powered systems
Background in high-performance networking, async systems, or low-latency architectures
Experience with container orchestration and cloud-native infrastructure
Familiarity with evaluation frameworks and model performance monitoring at scale
Experience working in fast-moving 0→1 or platform-building teams

Other:

Kraken is a fully remote company with Krakenites in 70+ countries.
The team builds and operates production systems that power intelligent agents at scale.
Engineers combine strong systems thinking with applied ML infrastructure experience.
The company celebrates diversity and hires strictly based on merit.
Kraken considers qualified applicants with criminal histories for employment.

Senior Software Engineer – AI Infrastructure

Skills Required

Description

Experience:

Key Skills:

Nice to have:

Other:

More Rust jobs