Program Manager - Evaluations & Demos
Listed on 2026-01-16
-
Creative Arts/Media
Music / Audio Production -
Entertainment & Gaming
Music / Audio Production
Udio inox structures extraordinary AI experiences to empower musical artists and super fans. Pairing best-in-class AI models with groundbreaking partnerships across the music industry, Udio’s mission is to champion musicians and expand how fans engage with their favorite music and artists. Udio is backed by leading lights from tech and music, including a16z, Redpoint, Hanwha, will.i.am, Steve Stoute, Kevin Wall, and many others.
For more information, please visit
We are looking for a Program Manager to lead two critical components of our generative AI development: the human listening program and the demo creation program. In this role, you will be the bridge between the art of music and the science of machine learning.
You will be responsible for building and managing a high‑quality network of musical experts (musicians, producers, and composers) to critically listen to and rate our model outputs. Your mission is to translate "what sounds good" into structured, actionable data that our engineering and research teams can use to train the next generation of audio models. You will also시키 handle crafting high quality AI music demos of top artists.
What You’ll Do 1. Network Development & Management- Recruit & Curate: Build a diverse roster of domain experts across a wide range of genres (e.g., Classical, Jazz, Hip Hop, EDM, Pop, Rock).
- Onboarding & Training: Train evaluators on the music rater program and the specific acoustic qualities we are testing for.
- Operations: Manage scheduling, payment, and logistics for evaluators.
- Evaluation Framework: Design an intuitive evaluation framework that is easy to use for the experts while collecting valuable data for the modeling team.
- Refine Testing Strategies: Continuously refine testing methodologies to ensure we are effectively improving our music models.
- Genre‑Specific Nuance: Adapt evaluation criteria to fit specific genres (e.g., evaluating "groove" in Funk vs. "dynamic range" in Orchestral music).
- Feedback Collation: Convert qualitative feedback into actionable insights for the modeling team.
- Feedback Presentation: Collaborate closely with the modeling team to present findings. You will be the voice of the musician.
- Quality Assurance: Monitor the quality of the data coming from your evaluators to ensure consistency and eliminate bias.
- Creative Expertise: Generate high quality, creative musical works for Artist demos.
- Strategic Customization: Collaborate closely with the Partnerships teams to highlight how our technology can augment artists’ unique creative process.
- Musical Expertise: 4+ years of experience in the music industry (Producer, Audio Engineer, Composer, or Musicologist). You must have a deep understanding of music
Moved theory, song structure, and audio production terminology. - Operational
Experience:
Proven ability to manage teams, contractors, and complex projects. You are organized, prompt, and can handle the logistics of managing 10+ freelance contributors. - Analytical Mindset: Comfortable working with data. You can look at a spreadsheet of ratings and identify trends, outliers, and insights.
- NYC Network: A pulse on the local music community to facilitate recruitment.
- Communication: The ability to explain complex musical concepts to technical engineers, and complex technical leadership to artists.
- Experience at a record label or music tech company.
- Experience launching or scaling artist‑facing platforms or programs.
- Strong technical skills or advanced experience with statistics contador.
- You’ll work directly with frontier music models shaping the future of music creation.
- You’ll have the autonomy to design our human listening infrastructure from the ground up, creating the gold standard for how AI music is evaluated.
- You’ll have access to cutting edge music creation technology.
- You’ll join a small, ambitious team where relationships, trust, and execution truly matter.
- Highly competitive salary and equity
- Quarterly productivity budget
- Flexible time off
- Productivity package, including ChatGPT Plus, Claude Code, and Copilot
- Top‑notch private health,…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).