We are looking for an AI & Data Engineer who has strong foundational expertise in data engineering and has extended that into building intelligent AI systems.

Company: Quest Global

Role: Lead Engineer - Data & AI

Location: Bengaluru, Karnataka, India

Key Skills:

Python
PySpark
Databricks
dbt
Airflow
Snowflake
BigQuery
Delta Lake
REST APIs
Kafka
LangGraph
MCP
A2A
FastAPI
Redis
Kubernetes

Role Focus:

Design, build, and maintain end-to-end batch and real-time data pipelines
Develop and manage ELT/ETL workflows
Build and maintain cloud data warehouse and lakehouse architectures
Implement dimensional models, SCD strategies, and incremental load patterns
Integrate data from diverse enterprise sources
Manage data quality, lineage tracking, and metadata documentation
Optimise query performance, partitioning strategies, and materialization approaches
Architect and build production-grade RAG pipelines
Build distributed agent-based systems
Design LLM evaluation and validation layers
Develop LLM-based automation workflows, recommendation systems, and document intelligence solutions
Build explainability layers
Deploy data and AI systems on Kubernetes with robust CI/CD pipelines
Design FastAPI microservices
Apply observability and monitoring best practices
Implement caching strategies and query optimisation techniques

Other:

Full-Time
18 countries
51 languages
21,000+ employees
intentional workplace culture
solve problems better and faster

Lead Engineer - Data & AI

Skills Required

Description

Key Skills:

Role Focus:

Other:

Prepare for this role

More LLM jobs