Senior Infra Engineer San Francisco

Join us and help shape the future of AI by architecting next-generation knowledge systems.

Join us and help shape the future of AI by defining the narrative around document understanding.

The Infra team at Llama Index owns the foundations that our product is built upon as well as many of the tools that enable engineers to develop, ship, and observe their code. We are responsible for designing, building, and scaling core infrastructure that powers a high-volume data platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing product.

We’re looking for folks with experience managing cloud infrastructure, working through various stages of scale, and helping the broader Engineering team be more effective and productive. Some traits that are important to our company culture: customer-obsessed, collaborative, hard-working, and optimistic. And we’re looking for owners, so we hope you’ll help us expand this list.

Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth.

Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments.

Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.

Enable external customer deployment success through maintaining clear infrastructure boundaries and principles.

Optimize and improve the release and deployment processes to enhance efficiency and reliability.

Ensure compliance with relevant regulations and implement robust security measures across different deployment environments.

5+ years of engineering experience.

Worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.)

Experience in optimizing cloud resource utilization.

Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency.

Willing to build Llama Index’s engineering culture as we grow.

You can balance speed and pragmatism and build the appropriate solutions for each stage of the company’s growth.

Experience building out infrastructure from the ground up at a fast-growing startup.

Experience with observability tools like Prometheus, Grafana, and New Relic.

Experience with Git Ops tools like ArgoCD and Flux for continuous deployment.

Experience with security compliance and audits in cloud environments such as SOC
2.

Familiar with Python, Postgres, multi-cloud deployments

We offer a hybrid-friendly culture based out of our downtown San Francisco office.

Impactful Mission: Work on innovative AI products that redefine how knowledge is accessed and utilized.

Collaborative Team: Join a team of passionate individuals committed to pushing the boundaries of technology.

Growth Opportunities: Be at the forefront of the AI revolution, with ample opportunities to grow alongside our scaling organization.

Competitive base salary and equity compensation

Comprehensive medical/dental/vision coverage for you and your family

Unlimited paid time off policy

Daily catered lunch and snacks in the San Francisco office

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Llama Index does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. Llama Index is not responsible for any fees related to unsolicited resumes.

We operate with complete honesty and stay true to our mission.

We adapt quickly, solve creatively, and thrive in ambiguity.

Exceptional Drive & Execution

We think strategically and deliver results with urgency.

Elevate & Empower

We share knowledge, build trust, and help teammates excel.

Deep Expertise

We value and cultivate deep domain knowledge. True innovation comes from mastering our craft and understanding the nuances of our field.