Associate AI Engineer

About ETS

ETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready. For more than 75 years, we've been advancing the science of measurement to build benchmarks for fair and valid skill assessment across cultures and borders. Our worldwide impact extends through our renowned assessments including TOEFL®, TOEIC®, GRE® and Praxis® tests, serving millions of learners in more than 200 countries and territories.

Through strategic acquisitions, we've expanded our global capabilities: PSI strengthens our workforce assessment solutions, while Edusoft, Kira Talent, Pipplet, Vericant, and Wheebox enhance our educational technology and assessment platforms across critical markets worldwide.

Through ETS Research Institute and ETS Solutions, we're partnering with educational institutions, governments, and organizations globally to promote skill proficiency, empower upward mobility, and unlock opportunities for everyone, everywhere. With offices and partners across Asia, Europe, the Middle East, Africa, and the Americas, we deliver nearly 50 million tests annually. Join us in our journey of measuring progress to power human progress worldwide.

The Associate AI Engineer contributes to the development of advanced, personalized adaptive learning technologies that power effective, efficient, and engaging educational experiences. As part of our AI product development team, you’ll help build, evaluate, and maintain large-language-model (LLM) driven content generation, review, and quality‑assurance systems that support large‑scale educational assessments.

• Adhere to ethical standards and comply with the laws and regulations applicable to the job function
• Contributing to the development of AI-enabled services and workflows, including LLM-based content generation and review pipelines, to achieve objectives as outlined by Senior or Principal AI Engineers
• Work with data scientists to assist in building data ingest and data transformation infrastructures
• Provide support to AI Engineers on the support assessment content, metadata, and evaluation pipelines during development, deployment, and recalibration
• Provide support to evaluate, benchmark, and monitor AI and LLM system behavior and provide metrics to document and track their performance.
• Explore the data and help to identify differences in data distribution that could impact performance when deployed in prototypes
• Utilize best practices around the support for the design, coding, automated unit, regression testing, and deployment of AI-enabled services and LLM-based workflows to production
• Keep current of latest AI research and applied advances in large‑language‑model platforms, orchestration tools, and evaluation methods relevant to educational assessment and content development
• Utilize best practices in the responsible use of AI
• Work closely with learning scientists and data scientists to define collection events and data transformations needed to drive personalized learning and to support assessment content development and review workflows
• Work closely with Product Owners to understand potential and limitations of AI and LLM-based systems in the product
• Work effectively in the agile‑at‑scale framework
• Clearly communicate findings, implementation details, and system behavior to senior AI engineers, product owners, and assessment domain experts

• Some experience with Python-based software and data engineering frameworks and libraries, Java, and/or R
• Some experience with APIs and services for large‑language models and related tooling (for example, model APIs, prompt‑driven workflows, or orchestration platforms such as Dify or similar tools)
• Knowledge of statistical analysis and mathematical modeling concepts and principles
• Familiarity with JSON-based APIs, data pipelines, and cloud-based services used to integrate AI capabilities into production systems
• Excellent communication skills
• Ability to work effectively in a cross‑functional team

• A Master’s Degree in Computer Science, Applied Mathematics, Engineering or a related field
• 1+ year of training or experience in…