Applied Research Scientist, LLM Evaluation

A company is looking for an Applied Research Scientist, LLM Evaluation & Post-Training.

Key Responsibilities Define and execute a research agenda focused on LLM evaluation and post-training Design rigorous experiments to study how evaluation methodologies impact fine-tuning and post-training outcomes Collaborate with AI/ML Research Engineers and Language Data Scientists to translate research methods into scalable evaluation and post-training pipelines

Required Qualifications MS/PhD in Computer Science, Machine Learning, Statistics, Applied Mathematics, AI, or a related quantitative scientific field (PhD strongly preferred) 5+ years of relevant experience in applied research/research science in ML/AI, with substantial work in LLMs or foundation models Demonstrated experience with LLM evaluation, benchmarking, alignment, and post-training research Strong coding skills in Python for research experimentation and analysis Experience working with modern ML tooling/frameworks (e.g., PyTorch, Hugging Face, JAX/Tensor Flow)