Member of Technical Staff - Engineering Lead

Member of Technical Staff - Engineering Lead About Patronus AI, Inc.

Patronus AI is building hyperrealistic, diverse reinforcement learning (RL) environments and benchmarks to steer frontier AI models. Our mission is to enable next generation AGI capabilities through scalable oversight.

We are a team of AI researchers and engineers formerly from companies like Meta AI, Amazon AGI, and Google. As a team, we have published research papers at top ML conferences (NeurIPS, EMNLP, ACL), and we are the creators of popular AI products and benchmarks such as Finance Bench, Simple Safety Tests , Copyright Catcher, Humanity’s Last Exam, and more. Our customers include foundation model labs and Fortune 500 enterprises like The Volkswagen Group.

We are backed by top‑tier investors including Notable Capital, Lightspeed Venture Partners, Stanford University, OpenAI, Databricks, and more.

As an Engineering Lead at Patronus AI, you will lead a team of engineers and researchers to develop dynamic benchmarks and RL environments to test and train foundation models. As the DRI for these benchmarks and environments, you will work directly with world‑class research teams to ensure quality and delivery.

This is a 0→1 leadership role solving hard problems in simulation design, reward modeling, world data integrity, and task validity. Your work will directly impact the capabilities of frontier models released by leading AI labs.

In this role, you will:

• Lead a team of Frontend, Backend, ML, Research, and QA engineers to build dynamic benchmarks and environments. Manage timelines, provide technical guidance, and ensure high‑velocity output across the team.
• Act as a DRI for benchmark and environment delivery, stepping in hands‑on to unblock the team as needed.
• Partner directly with research teams at leading AI labs to turn real‑world failure modes into benchmarks and environments that measurably drive model improvements where it matters most.
• Work closely with researchers at SORL (Patronus AI’s Scalable Oversight Research Lab) to help design experimental benchmarks and environments.
• Work closely with the Head of Engineering to drive processes and set the engineering vision across the company.

• BS/MS in Computer Science, Mathematics, Statistics, or another quantitative field.
• Have 2+ years of experience leading engineering teams.
• Demonstrated ability to take ambiguous problems from 0→1 and deliver high‑impact outcomes end‑to‑end.
• Experience with modern UI frameworks like React and web‑oriented programming languages like Type Script.
• Experience with Python and backend frameworks like FastAPI or Django.
• Experience with relational databases such as Postgre
  
  SQL and familiarity with vector databases and columnar databases.
• Experience working and communicating cross‑functionally in a team environment.
• Creativity in problem solving and strong communication skills.
• Have good character, integrity, and respect for others.
• Competitive salary and equity packages.
• Health, dental, and vision insurance plans.
• 401(k) plan.
• Fun global offsites.

Patronus AI is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.