Seeking a Senior AI Platform Software Engineer to design and implement AI model APIs and integrate LLMs using Azure AI technologies.

Role: Senior AI Platform Software Engineer

Location: India

5–8 years of experience in software engineering / backend systems
2–3 years of AI experience (LLMs, RAG pipelines, API-based AI systems, microservices)

Design and implement high-performance RESTful or GraphQL APIs to expose AI model functionality
Integrate LLMs using Azure OpenAI / Azure AI Foundry and custom ML models into backend architectures
Use frameworks like LangChain, LangGraph, FastAPI for AI orchestration
Build and maintain data ingestion pipelines and vector databases for RAG
Deploy and manage services using Docker and Kubernetes across cloud platforms with focus on Microsoft Azure
Implement real-time monitoring and alerting for model performance, latency, and drift
Design testing strategies for non-deterministic AI outputs including guardrails and safety constraints
Own the end-to-end development lifecycle in a SaaS environment including code quality, SLOs, and incident response
Collaborate effectively within a team environment
Mentor engineers in AI engineering best practices including GenAI and classical ML
Conduct code reviews and provide structured feedback

More LLM jobs