Grafana Labs is seeking a Senior AI Engineer to develop AI-driven observability tools that help users detect, triage, and resolve incidents. This remote role focuses on building scalable AI features and collaborating cross-functionally to improve infrastructure and observability quality.

Company: Grafana Labs

Role: Senior AI Engineer

Location: United States (Remote)

Experience:

Experience with LLMs, prompt engineering, and building applications powered by GenAI
Proven track record of delivering software that made it into production and is actively used by users
Exposure to working in cloud-native environments (e.g., AWS, GCP, Azure)
Experience using observability tools to understand and troubleshoot system behavior
Strong engineering skills building production software systems (backend and/or full stack)

Key Skills:

AI technologies and frameworks
LLMs
Prompt engineering
GenAI
Cloud-native environments
AWS
GCP
Azure
Observability tools
Agent frameworks
Multi-agent workflows
Kubernetes
Docker
Terraform
Model fine-tuning techniques
Observability tooling

Role Focus:

Build and deliver high-performance AI features for incident detection, triage, and resolution
Rapid experimentation and iteration with prototyping, testing, and validating with real users
Collaborate with data analysts, product managers, and designers to shape AI-driven product features
Integrate agentic components with internal tools, alerting systems, runbooks, and developer workflows
Use AI and automation tools to enhance product functionality and development workflows
Take full ownership of AI solutions ensuring scalability, maintainability, and alignment with user workflows
Communicate effectively in a dynamic and collaborative environment

Additional responsibilities:

Operate with a high degree of autonomy and ownership
Use modern AI coding assistants with company-funded usage budget
Encourage pragmatic AI-assisted development including faster prototyping, test generation, refactors, documentation, and incident follow-ups
Work in a highly collaborative culture valuing curiosity, feedback, and cross-functional partnership
Deal with ambiguity and define scope where loosely defined
Contribute to a global collaborative culture with transparency, autonomy, and trust

Nice to have:

Experience building or working with agent frameworks or multi-agent workflows
Experience with infrastructure/devops tooling such as Kubernetes, Docker, Terraform
Familiarity with model fine-tuning techniques
Experience building observability tooling

Other:

100% remote company with 1,600+ team members across 40+ countries
Base compensation range USD 127,651 - USD 203,867 in the United States
Benefits include equity, bonus (if applicable), and other benefits
All roles include Restricted Stock Units (RSUs)
Company culture emphasizes open source legacy, global collaboration, transparency, autonomy, and trust
In-person onboarding to integrate new hires
Global annual leave policy of 30 days per annum with 3 days reserved for Grafana Shutdown Days
Equal opportunity employer committed to diversity and inclusion
Use of AI tools in recruitment process to assist in matching CVs to job postings

Senior AI Engineer

Skills Required

Description