Senior AI Backend Engineer Tel-Aviv, IL
Listed on 2026-02-17
-
Software Development
AI Engineer, Cloud Engineer - Software, Backend Developer, Software Engineer
Location: New York
Founded in 2016, K Health's mission is to deliver accessible, high-quality healthcare a leading clinical AI company in primary care, K Health has developed a suite of clinical AI agents that enhance provider efficiency and improve patient outcomes. K Health's virtual primary care platform is enhanced by an AI copilot to complete the initial patient intake, summarizing relevant history from the EMR, and generating “the perfect note” to reduce the time providers spend on basic data collection and non‑clinical tasks.
Unlike other virtual medicine companies, K Health delivers comprehensive, longitudinal primary care in a virtual setting, enabling our clinicians to be true primary care providers without sacrificing scope of practice or continuity of care.
As a venture‑backed startup trusted with nearly $400 million in funding and a $900 million valuation as of July 2024, K Health is well‑positioned for sustained future growth. We are expanding our partnerships with major health systems (Cedars‑Sinai, Hackensack Meridian Health, Hartford Health Care), enhancing accessibility and quality of care by pairing people with technology. Our providers are credentialed at these renowned academic health systems and adhere to their clinical guidelines, ensuring patient‑first, evidence‑based care.
Fully integrated into Epic, our AI platform enables K Health to operate as an extension of existing healthcare systems, benefiting from a built‑in network of specialists and social services to seamlessly serve patients within those communities. Our unique care delivery model enables our providers to deliver the same high‑quality, accessible care to a mixed‑payer population, including those with commercial insurance, Medicare, and Medicaid.
Join us in our mission to deliver smarter, simpler healthcare of the future - today!
About the role:We are seeking a Senior Backend Engineer with deep backend engineering expertise and proficiency in one or more major programming languages (e.g., Python, Java, Go, Rust, or Kotlin), along with a strong understanding of AI models and agents. As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production‑ready infrastructure and APIs that power intelligent systems.
What you’ll be doing :As a Senior Backend Engineer in the AI Engineering team, you will:
- Build and maintain reliable, scalable backend services to support AI agent execution and orchestration.
- Develop AI agent systems for complex operational workflows using Lang Chain, Lang Graph, LiteLLM, and Langfuse.
- Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self‑hosted and fine‑tuned LLMs like Gemma and Llama.
- Build and maintain integrations with clinical systems (FHIR, EMR).
- Drive observability and reliability using Open Telemetry, Datadog, and Langfuse.
- Design APIs (Graph
QL, REST), background workers, and event‑driven systems that interface with AI inference engines and agent runtimes. - Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve the performance, scalability, and reliability of backend systems.
- Participate in code reviews, knowledge sharing, and mentoring to elevate the team’s technical capabilities.
- 6+ years of backend engineering experience, with strong proficiency in more than one major programming language (such as Python, Java, Go, Rust, or Kotlin).
- Solid understanding of AI systems architecture and experience working in environments involving AI agents, LLMs, or inference pipelines.
- Proven experience in building and scaling backend APIs, microservices, and background jobs.
- Strong experience with relational and No
SQL databases (e.g., Postgre
SQL, MySQL, Mongo
DB, Redis), including schema design, data modeling, and query optimization. - Experience with message brokers and distributed systems (e.g., Pub/Sub, Redis Streams, Rabbit
MQ). - Highly adaptable, a strong team player, with the ability to quickly learn and apply new technologies.
- Strong proficiency in Python and/or Node.js/NestJS.
- Experience with clinical systems and healthcare data…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).