Experience:

• 2+ years professional experience as a software engineer, data scientist, psychometrician, machine learning engineer

Qualification:

• Bachelor’s degree in a quantitative field (CS, EE, statistics, math, data science)

Responsibilities:

• Train, evaluate, and deploy machine learning models for scoring student responses
• Monitor performance of deployed models to ensure consistent, fair, and unbiased scoring
• Recalibrate deployed models as needed
• Maintain, update, and improve code base for training and deploying models
• Evaluate historical model performance and conduct experiments to improve modeling techniques
• Research and stay up-to-date on emerging NLP technologies
• Support administration of Pearson’s automated scoring programs
• Support execution of initiatives to innovate and improve automated scoring technologies
• Collaborate with program managers, quality assurance engineers, psychometricians, and internal stakeholders

Additional responsibilities:

• Attend and present at conferences as a thought leader in automated scoring
• Work closely with the Manager of AI Scientist
• Manage multiple tasks and projects simultaneously
• Work effectively as a member of a collaborative team
• Communicate effectively with colleagues of varying technical and non-technical abilities
• Demonstrate curiosity and continuous learning mindset
• Passionate about agile software processes, data-driven development, reliability, and systematic experimentation

Nice to have:

• Advanced degree in a quantitative field
• Track record of producing machine learning models and production infrastructure at scale
• Familiarity with traditional NLP techniques and latest advancements in LLMs, generative AI, active learning, and reinforcement learning
• Strong experience with machine learning in non-NLP domains
• Experience using containerized technologies such as Docker and Kubernetes

More skills:

Linux commands, software engineering fundamentals, database access patterns, API access patterns, testing, natural language processing (NLP), large language models (LLMs), containerized technologies

Other:

• Full-time salary range: $130,000 - $160,000
• Eligible to participate in an annual incentive program
• Equal Opportunity Employer and member of E-Verify
• Reasonable accommodations available for individuals with disabilities
• Job family: TECHNOLOGY
• Schedule: FULL_TIME
• Job: Data Engineering