We are looking for a Software Engineer to design and implement core platform capabilities for AI/ML and AI Agents in SingleStore Cloud.

Company: SingleStore

Role: Software Engineer | AI Platforms

Location: India

4+ years of experience working on a SaaS product or production platform
Experience building cloud native services: Kubernetes, containers, service-to-service APIs, CI/CD
Strong software engineering skills with experience in distributed systems (Go, Python, or similar)

Build and evolve backend services that power AI features: agent orchestration, tool execution, retrieval/RAG pipelines, and model serving integrations
Design APIs and control plane workflows for AI platform components (tenant-aware, secure by default, observable)
Implement MCP style tool discovery / integration patterns so agents can safely call tools, connectors, and internal services
Work closely with product managers, designers, customers, and partner engineering teams to deliver high quality AI experiences
Engineer for reliability and scale: latency, cost controls, rate limiting, fallbacks, rollouts, and incident response readiness
Establish best practices around evaluation: offline test sets, regression detection, prompt/model/version tracking, and quality gates
Contribute to secure AI by design approaches: permissions, data access boundaries, prompt injection defenses, and auditability
Mentor junior engineers and contribute to a welcoming, high ownership team environment

Hands on experience with AI agents and orchestration frameworks (tool calling, workflows, planners/executors)
Practical experience with RAG systems, reranking, grounding, and evaluation strategies
Experience with model serving patterns (batch/online inference, caching, streaming responses)
Knowledge of security considerations for AI systems (data isolation, RBAC, prompt injection threats, audit logs)
Familiarity with vector databases or vector capabilities in modern data platforms
Experience with observability stacks (structured logging, metrics, tracing) and SLO driven engineering

More LLM jobs