ETS is seeking an AI Model Development Engineer to support the TOEFL and GRE assessment programs by designing, developing, evaluating, and deploying machine learning models.

Company: ETS

Role: AI Model Development Engineer

Experience:

3+ years of experience developing machine learning models in production environments, preferably in large scale scoring environments

Key Skills:

Machine learning
Deep learning
NLP
Transformer architectures
LLM fine-tuning
Speech processing
Python
MLOps tools (MLflow, Kubeflow, KServe, or equivalent)
TensorFlow
PyTorch
JAX

Qualification:

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, Engineering, or related field

Role Focus:

Develop, train, and optimize machine learning and deep learning models for automated scoring
Implement feature engineering, representation learning, and model architectures
Develop hybrid scoring approaches combining AI models with rules-based or human-in-the-loop workflows
Build model pipelines, evaluation frameworks, and testing approaches
Collaborate with psychometric and validity teams to ensure AI-driven systems meet technical, fairness, and measurement standards
Partner with engineering teams to deploy models into scalable, production-grade systems

Additional responsibilities:

Conduct experiments to compare model architectures, datasets, training regimes, and performance tradeoffs
Implement monitoring solutions to track model drift, robustness, and security risks over time
Participate in cross-functional design sessions
Document model design, training data specifications, evaluation metrics, and deployment requirements
Stay current with advancements in LLMs, generative AI, responsible AI, and educational technology

Other:

Salary: $132000 USD - $142000 USD
Multiple Business Resource Groups (BRG) for career growth
Up to an additional 8 hours of PTO for volunteer work

AI Model Development Engineer

Skills Required

Description