Scientist, Data Scientist, Data Analyst
Job in
Greater London, London, Greater London, EC1A, England, UK
Listed on 2026-01-13
Listing for:
MakiPeople
Full Time
position Listed on 2026-01-13
Job specializations:
-
IT/Tech
Data Scientist, Data Analyst, AI Engineer, Data Science Manager -
Research/Development
Data Scientist
Job Description & How to Apply Below
Location: Greater London
Be among the first 25 applicants.
About The Science TeamAt the heart of Maki People, the Science team shapes the future of hiring through innovation, rigor, and collaboration. Led by our Head of Science, Aiden Loe, and working closely with our COO, Paul-Louis Caylar, this team drives the development of high‑quality content that sets our platform apart.
- Expanding a cutting‑edge library of tests and tools.
- Designing bespoke activities and experiences for clients.
- Evaluating and refining AI‑driven scoring algorithms and large language models (LLMs) to ensure fairness, accuracy, and transparency.
- Leveraging psychometric expertise to build reliable, valid, and impactful assessments.
- Developing tools that analyze candidate and job data to predict performance and potential with precision.
- Supporting clients in using assessment data to optimize their workforce strategies, from talent acquisition to development and retention.
- Leading original studies to explore emerging psychological and technological trends and sharing insights through publications, presentations, and client reports.
- Collaborating with regulatory bodies and industry leaders to establish new standards in ethical AI use and hiring practices.
- Equipping internal teams and clients with the knowledge and skills needed to understand and apply psychological and AI‑driven insights effectively.
The Role
- Selection & Evaluation of AI & Psychometric Models
- Assess the statistical accuracy and reliability of LLMs used for automated scoring (e.g., structured grid methods; job‑specific skills; multi‑lingual proficiency tests – written and spoken).
- Compare and validate STT/TTS models and assess their downstream impact on candidate scores.
- Continuously identify and evaluate emerging LLM, STT, and TTS models to optimise scoring precision and efficiency.
- Evaluate and calibrate psychometric models (e.g., CTT, IRT, CFA) to ensure the scientific validity and comparability of AI‑scored assessments across populations and test forms.
- Human‑AI Comparison & Hybrid Evaluation Models
- Design research comparing AI‑scored assessments with expert human judgments to ensure validity and alignment.
- Benchmark semantic and embedding models (e.g., BERT, GPT‑4, MPNet, Deep Seek) for diverse assessment types.
- Develop hybrid scoring pipelines combining human oversight and AI‑driven analytics.
- Bias & Fairness Analysis
- Detect and analyse potential biases in AI‑generated or psychometric scores across demographic groups.
- Apply fairness and bias‑mitigation techniques (e.g., reweighting, calibration, subgroup analysis) while maintaining model performance integrity.
- Contribute to internal fairness dashboards and compliance documentation, supporting transparent model governance.
- Continuously evaluate model generalisability and fairness to ensure all predictive algorithms adhere to ethical and scientific standards.
- Predictive Analytics & Performance Insights
- Work with large‑scale assessment and performance datasets to model relationships between candidate scores, job performance, and retention outcomes.
- Develop and test predictive models that estimate success probabilities or identify key behavioural and linguistic predictors of performance.
- Collaborate with data science, implementation and customer success teams to translate insights into actionable recommendations for clients and internal stakeholders.
- Ongoing Model Monitoring & Issue Resolution
- Investigate anomalies raised by clients or internal QA.
- Conduct diagnostic analyses and recommend evidence‑based improvements.
- Technical Research Combining AI & Psychometrics
- Explore fine‑tuning, prompt‑engineering, and evaluation methods to enhance model performance.
- Translate technical findings into actionable insights for non‑technical stakeholders.
- Prepare and disseminate research through internal reports, publications, or conferences.
- Advanced degree (PhD/MSc) in Data Science, Machine Learning, Psychometrics, Computational Linguistics, or Psychology.
- Proven expertise in AI model evaluation, psychometric validation, and statistical analysis.
- Basic knowledge of psychometric modelling (e.g., IRT, CFA, CAT) and its application in assessment design…
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×