Principal Software Developer - OCI AI

At Oracle Cloud Infrastructure (OCI), we are building the future of cloud computing—designed for enterprises, engineered for performance, and optimized for AI  are a fast-paced, mission-driven team within one of the world’s largest cloud platforms.

The AI Data & Dev Platform Strategy team within OCI is focused on developing infrastructure and tools to operationalize Large Language Models (LLMs) and agentic AI systems. Our goal is to empower developers and enterprises to deploy intelligent applications and agents that integrate seamlessly with cloud services.

As a Principal Software Engineer (IC4), you will contribute to the design and implementation of scalable, distributed systems that serve LLMs and support agent-based workflows. You will work in a collaborative environment with applied scientists, ML engineers, and software teams to deliver performant and reliable AI application. This is a high-impact engineering role with opportunities to grow technical expertise in large-scale systems and advanced AI technologies.

• BS in Computer Science or related technical field.
• 6+ years of experience in backend software development with cloud infrastructure or 6+ years of experience in frontend software development.
• Strong proficiency in at least one language such as Go, Java, Python, C++, or React, Vue.js, Svelte for frontend.
• Experience building and maintaining distributed services in a production environment.
• Familiarity with Kubernetes, container orchestration, and CI/CD practices.
• Solid understanding of computer science fundamentals such as algorithms, operating systems, and networking.

• MS in Computer Science.
• Experience working with LLM serving frameworks like vLLM, Deep Speed, or Faster Transformer.
• Exposure to agent-based AI systems or tool-based inference workflows.
• Knowledge of cloud-native observability tools and scalable service design.
• Experience in Lang Chain and/or Lang Graph is a big plus.

• Build mission-critical AI application with real-world impact.
• Work closely with a collaborative and experienced global team.
• Expand your knowledge in AI, cloud computing, and distributed systems.
• Contribute to one of Oracle’s most innovative and fast-growing initiatives.

• Contribute to the design and development of scalable SaaS application features that deliver business value to customers in the Generative AI domain.
• Implement user-facing features and backend services that interact with Large Language Models (LLMs) and other advanced AI capabilities using modern frameworks and cloud-native technologies.
• Collaborate with product, design, and QA teams to ensure delivery of high-quality, intuitive, and reliable AI-driven application experiences.
• Assist in diagnosing and resolving application issues, enhancing performance, and ensuring application availability and security, particularly in the context of AI model integration.
• Write maintainable, well-tested code, and actively participate in code reviews, documentation, and architectural discussions related to Generative AI workflows and system design.

Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only.

US:
Hiring Range in USD from: $96,800 to $223,400 per annum. May be eligible for bonus and equity.

• Medical, dental, and vision insurance, including expert medical opinion
• Short term disability and long term disability
• Life insurance and AD&D
• Supplemental life insurance (Employee/Spouse/Child)
• Health care and dependent care Flexible Spending Accounts
• Pre-tax commuter and parking benefits
• 401(k) Savings and Investment Plan with company match
• Paid time off:
  Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment.
  
  Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
• 11 paid holidays
• Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
• Paid parental leave
• Adoption assistance
• Employee Stock Purchase Plan
• Financial planning and group legal
• Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.