The AI Software Engineer, Legal Prompting & LLM Development role at Nixon Peabody involves building production-grade applications that interact with Large Language Models (LLMs) to deliver cutting-edge solutions to attorneys and clients.

Company: Nixon Peabody

Role: AI Software Engineer, Legal Prompting & LLM Dev.

Location: Boston, MA; Chicago, IL; Los Angeles, CA; New York City, NY; Rochester, NY; San Francisco, CA; Washington, DC; Remote

Experience:

4-6 years of production-level software engineering experience
Prior experience developing software solutions in the legal industry strongly preferred

Key Skills:

TypeScript/JavaScript
C#
Python
Java
RESTful APIs
SQL databases
NoSQL
vector stores
LLM APIs (OpenAI, Anthropic, Cohere, Azure OpenAI)
prompt engineering techniques
Model Context Protocol (MCP) servers
orchestration frameworks (LangChain, LlamaIndex, Semantic Kernel)
RAG pipelines
evaluation frameworks (Ragas, DeepEval, promptfoo)
LLM observability platforms
containerization (Docker)
CI/CD
cloud deployment (Azure, AWS, GCP)

Qualification:

Bachelor’s degree in Computer Science, Engineering, or a related technical field
Legal background highly preferred (e.g., J.D., paralegal, legal tech industry experience)

Role Focus:

Design, develop, and deploy LLM-integrated applications
Develop backend services across the Microsoft stack
Build and maintain RESTful and event-driven APIs
Write and refine persona-based prompts
Build prompt evaluation harnesses
Design, build, and operate Model Context Protocol (MCP) servers
Develop multi-step and multi-agent workflows
Implement guardrails and content filters

Additional responsibilities:

Perform other duties as assigned
Collaborate with attorneys, legal professionals, and product teams

Nice to have:

Demonstrated experience in legal practice or support roles
Experience with vector databases (e.g., Pinecone, Weaviate, pgvector, Azure AI Search)
Familiarity with LangGraph, LlamaIndex, or Pydantic AI

Other:

A career at Nixon Peabody offers the opportunity to do work that matters
The firm provides fast growth, connectedness, and training in business and law
The work environment promotes success for clients and employees

AI Software Engineer, Legal Prompting & LLM Dev.

Skills Required

Description