Software Engineer, AI Engineer, Machine Learning​/ ML Engineer

Software Engineer — LLM Evaluation

Role

Summary:

We are seeking a Senior Software Engineer to evaluate and improve Large Language Models (LLMs) by building high-quality engineering datasets, reviewing and refining AI-generated code, and developing automated systems to validate code correctness, performance, and scalability. This role bridges real-world software engineering and AI research to advance AI-driven coding systems at scale.

Responsibilities:

• Create and curate production-grade code examples for LLM training
• Evaluate, debug, optimize, and correct AI-generated code across multiple languages
• Build automated verification and benchmarking frameworks for code quality
• Collaborate with researchers and engineers to assess and improve AI coding performance
• Provide structured technical feedback to enhance model reasoning and accuracy

Required experience:

• 5+ years of professional software engineering experience
• Strong proficiency in Python and JavaScript, with experience in system design and production systems
• Solid understanding of software architecture, testing, debugging, and code quality
• Experience building scalable, maintainable applications

Preferred:

• Experience with AI/ML systems or LLM evaluation
• Background in developer tooling, testing frameworks, or automation
• Strong interest in improving AI-assisted software development