Learning Measurement Specialist, Global Ops Learning & Development

Description

GOLD seeks an exceptional leader to transform how we measure, assess, and evaluate learning effectiveness in an AI-first world. As Principal, Learning and Measurement Specialist, you'll architect the measurement strategy that proves learning drives business impact across 126,000+ leaders in Global Operations and PXT.

This role sits at the intersection of learning science, data analytics, and AI innovation. You'll design measurement frameworks that capture not just completion rates, but actual capability growth and business outcomes. You'll partner with PXT Central Science, multiple analytics teams, and program owners to build the infrastructure that demonstrates clear ROI across our learning investments that are born in a native-AI environment.

The challenge: traditional measurement approaches (surveys, completion rates, satisfaction scores) don't capture how AI-enabled, in-the-flow learning actually builds capability. You'll pioneer new approaches that track learning interactions, predict capability growth, and correlate with business results. As new frontiers of measurement and experimentation surface, the role will evolve to take on the next phase of measurement for ongoing learning sustainment and optimization.

Key job responsibilities

Architect GOLD's Measurement Strategy:

- Design and implement Ops-wide measurement frameworks that evaluate learning effectiveness across all delivery modalities (in-person, online, AI-enabled, on-demand)

- Build the "fingerprints" approach: capture salient interaction data from AI learning experiences to predict capability growth without creating surveillance systems

- Partner with PXT Central Science to validate measurement methodologies and ensure scientific rigor

- Create ROI frameworks that connect learning investments to business outcomes (attrition reduction, productivity gains, leadership effectiveness)

Drive Experimentation and Validation:

- Design and execute experiments that test learning effectiveness across different delivery methods

- Partner with program owners to implement A/B testing, control groups, and longitudinal studies

- Use Automated Causal Evaluation (ACE) tool to measure impact of learning interventions

- Translate experimental findings into actionable recommendations for program design

Build Measurement

Infrastructure:

- Collaborate with Analytics Delivery Service (ADS) and tech partners to build dashboards and reporting mechanisms

- Establish data pipelines that connect learning interactions to business outcomes

- Create self-service analytics tools that empower program owners to track their own impact

- Ensure data privacy, compliance, and ethical use of learning analytics

Influence Without Authority:

- Lead GOLD Measurement Working Group to drive alignment across siloed program teams

- Secure leadership buy-in for shared measurement vision and standards

- Partner with regional teams, business lines, and functional experts to implement measurement frameworks

- Communicate measurement insights to executive stakeholders

About the team

GOLD (Global Operations Learning & Development) transforms how 1.2M+ employees learn 're shifting from traditional classroom training to AI-enabled, in-the-flow learning experiences. Our team includes learning designers, program managers, regional partners, and data scientists-all focused on building capability at scale.

Basic Qualifications

- 4+ years of designing experiments and statistical analysis of results experience

- Experience applying concepts of learning science, educational psychology, and instructional design principles to learning solutions

- Experience influencing at all levels within an organization, particularly at the executive level

- Experience with one or more industry analytics visualization tools (e.g. Excel, Tableau, Quick Sight, Micro Strategy, Power

BI) and statistical methods (e.g. t-test, Chi-squared)

- 8+ years of learning design, learning science, instructional design, educational psychology, or similar field experience

- Knowledge of quantitative data analysis and statistics

Preferred Qualifications

- Bachelor's degree, or 10+ years of learning design, learning science, instructional design, educational psychology, or similar field experience

- Experience in several of the following areas: machine learning, statistics, deep learning, natural language processing, or information retrieval

- Experience leading large-scale programs/projects

- Familiarity with Amazon's learning ecosystem (Learn, AZA, Success Profiles, Capabilities)

- Certification in learning measurement (e.g., Kirkpatrick, Phillips ROI Methodology)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or…