You are a strategic thinker passionate about building prompt-driven, production-grade AI that measurably improves risk and control outcomes across enterprise workflows.

Company: JPMorgan Chase

Role: Software Engineer III - AI/ML, Prompt Engineer

Location: Mumbai, Maharashtra, India; Nirlon Knowledge Park, Western Express Highway, Goregaon (East), Mumbai, IN-MH, 400063, IN

Experience:

5+ years of hands-on experience in machine learning, applied AI, or prompt engineering in production environments
5+ years of experience with Python and ML/AI tooling (model development, evaluation, and deployment)
3+ years of experience with LLM application development, prompt engineering, or NLP systems
1+ years of experience with experimentation frameworks, A/B testing, and production monitoring of AI features

Key Skills:

Python
ML/AI tooling
LLM application development
prompt engineering
NLP systems
PyTorch
TensorFlow
scikit-learn
Hugging Face Transformers
LangChain
Pinecone
pgvector
graph databases
relational/NoSQL systems

Qualification:

BS/BA degree in Computer Science, Engineering, Machine Learning, Data Science, Statistics, or equivalent experience

Role Focus:

Design production-grade prompts for complex enterprise workflows; test, iterate, and optimize based on outcomes.
Apply familiarity with ML models, including classification, NLP, and transformer-based architectures.
Define and execute prompt/model evaluation criteria (accuracy, consistency, hallucination rate, policy adherence).
Design and run offline and online experiments to improve prompts and tune model performance.
Implement guardrails, safety filters, and fallback strategies in production AI/ML workflows.
Build multi-step agent workflows using LangChain or similar orchestration frameworks.
Leverage modern databases—including vector stores (e.g., Pinecone, pgvector), graph databases, and relational/NoSQL systems—for retrieval and persistence.
Optimize embeddings usage, tokenization strategies, and context-window management.
Prepare data, engineer features, and curate datasets for ML training and evaluation.
Monitor AI/ML-assisted production workflows with observability and drift detection practices.
Translate complex business requirements into structured prompt, model, and system designs.
Develop Python-based orchestration, data transformation, and automation scripts.
Collaborate effectively with software engineers, product owners, and control stakeholders.
Communicate clearly in writing and verbally to both technical and business audiences.

Nice to have:

Experience with responsible AI practices and model governance
Experience in financial services, technology risk, or controls-oriented environments
Relevant ML/AI certifications (e.g., AWS ML Specialty, Google Professional ML Engineer)
Understanding of enterprise risk, controls, and auditability expectations

Other:

Full-time, day shift
Equal opportunity employer, diversity and inclusion valued
Reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs

Software Engineer III - AI/ML, Prompt Engineer

Skills Required

Description