Software Engineer, AI Phone Assistant
Listed on 2026-02-28
-
IT/Tech
AI Engineer, Data Scientist
Location: New York
Overview
Our mission is to improve healthcare experiences for patients by empowering them with access to information and easy booking. Zocdoc’s leading healthcare marketplace enables finding and booking in-person or virtual care across all 50 states, 200+ specialties, and 12k+ insurance plans. We are committed to solving important, complex problems with thoughtful, driven, and collaborative teammates.
Your Impact on Our MissionHelp shape the future of healthcare communication by building Zocdoc’s AI Phone Assistant Zo, an intelligent voice agent that answers inbound calls for hospitals and doctor’s offices. This is a high-impact, high-growth initiative where you’ll help design, build, and scale AI systems that redefine how patients and providers connect. This team continuously researches, experiments, and evaluates how AI systems behave in production, focusing on designing intelligent flows, orchestration, and decision-making beyond individual model calls.
YourDay to Day
- Architect, build, and maintain high-quality, scalable software systems that power Zocdoc’s AI Phone Assistant.
- Design and implement AI-driven workflows, integrating large language models (LLMs) and conversational AI into production systems.
- Lead prompt engineering, model integration, and system optimization to improve accuracy, responsiveness, and reliability.
- Collaborate cross-functionally with product, design, and data science teams to deliver production-grade AI capabilities.
- Drive the evolution of our AI platform — from experimentation and rapid prototyping to scalable, reliable systems in production.
- Ensure system scalability, observability, and performance as the product grows rapidly.
- Stay ahead of emerging GenAI tools and technologies and apply them to solve real-world user problems.
What You’ll Bring
- 7+ years of professional software development experience, including at least 2+ years building or integrating AI/ML systems in production
- Strong proficiency in C#, with experience in distributed systems and microservices
- Experience with large language models (LLMs), prompt engineering, or AI-powered conversational interfaces
- Proven ability to design, build, and scale complex, reliable, high-performance systems
- Strong foundation in data structures, algorithms, and software design principles
- Technical leadership and ownership over major systems or product areas
- Strong collaboration and communication skills to partner across disciplines
- A passion for leveraging AI to build products that make a real difference in people’s lives
- Flexible, hybrid work environment
- Unlimited PTO
- 100% paid employee health benefit options
- Employer funded 401(k) match
- Corporate wellness programs with Wellhub
- Sabbatical leave for employees with 5+ years of service
- Competitive parental leave
- Cell phone reimbursement
- Great Place to Work Certified
- Catered lunch and snacks
- Commuter Benefits
- Convenient Soho location
Salary ranges are determined through alignment with market data. Base salary offered is determined by experience, qualifications, and skills. Some positions are eligible for variable pay and/or equity; your recruiter will discuss the full compensation package. NYC Base Salary Range $180,000 — $270,000 USD.
About UsZocdoc is the country’s leading digital health marketplace that helps patients easily find and book the care they need. Millions use our free service each month to find nearby, in-network providers, compare verified reviews, and instantly book visits online. Zocdoc is mission-driven and guided by values focused on empowering patients and collaboration. We are an equal opportunity employer and are committed to providing a work environment free of discrimination and harassment.
We consider applicants without regard to race, color, ethnicity, religion, national origin, gender, sex, gender identity, gender expression, sexual orientation, age, citizenship, marital or parental status, disability, veteran status, or any other protected characteristic. Job Applicant Privacy Notice is available to applicants.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).