Senior Software Engineer, AI Model Serving

Senior Software Engineer, AI Model Serving

Redhat, Raleigh, NC, On-site, Remote

The Red Hat Open Shift AI (RHOAI) team is looking for a Senior Software Engineer with Kubernetes and MLOps (Machine Learning) experience. As a core developer for the Model Server and Metrics team, you will participate in open-source communities like KServe, Kubeflow, and vLLM.

• Contribute to the architecture, design, development, and testing of new features and solutions for RHOAI.
• Innovate in the MLOps domain by participating in upstream communities, such as Kube Flow and KServe.
• Ensure non-functional requirements including security, resiliency, and maintainability are met.
• Write unit and integration tests and work with quality engineers to ensure product quality.
• Use CI/CD best practices to deliver solutions as productization efforts into RHOAI.
• Contribute to a culture of continuous improvement by sharing recommendations and technical knowledge with team members.
• Collaborate with product management, other engineering and cross-functional teams to analyze and clarify business requirements.
• Communicate effectively to stakeholders and team members to ensure proper visibility of development efforts.
• Give thoughtful and prompt code reviews.
• Represent RHOAI in external engagements including industry events, customer meetings, and open-source communities.
• Mentor and guide other engineers.
• Proactively utilize AI-assisted development tools for code generation, auto-completion, and intelligent suggestions.
• Explore and experiment with emerging AI technologies.

• Minimum of 5 years of experience.
• Passion for writing and maintaining reliable code.
• Experience with monitoring and alerting tools such as Prometheus and Grafana.
• Excellent written and verbal communication skills; fluent English language skills.
• Strong experience developing applications in Python, GoLang is a plus.
• Strong experience in Kubernetes or Open Shift.
• Experience with source code management tools such as Git.
• Strong system understanding and troubleshooting capabilities.
• Autonomous work ethic.
• Familiarity with data science workflows and machine learning pipelines.

• Bachelor's degree or higher in computer science or a related discipline.
• Understanding of how Open Source and Free Software communities work.
• Experience with development for public cloud services (AWS, GCE, Azure).
• Experience working with or deploying MLOps platforms.
• Experienced in Open Shift based solutions.
• An existing contributor in one or more MLOps open-source projects such as Kube Flow, KServe, Ray Serve, and vLLM.

#AI-HIRING

The salary range for this position is $ - $. Actual offer will be based on your qualifications.

Comprehensive medical, dental, and vision coverage, Flexible Spending Account, Health Savings Account, Retirement 401(k) with employer match, Paid time off and holidays, Paid parental leave plans, Leave benefits, Additional benefits.

Red Hat is an equal opportunity workplace and affirmative action employer.