Senior System Software Engineer - Dynamo and Triton Inference Server

Why consider this job opportunity:

Employer Industry: Technology (Artificial Intelligence)

• Base salary range of $184,000 - $356,500 depending on level and experience
• Eligibility for equity and comprehensive benefits
• Opportunity for career advancement within a leading technology company
• Work in a fast‑paced, agile team environment with a focus on innovation
• Collaborate with some of the most expert and passionate professionals in the field
• Chance to contribute to groundbreaking advancements in AI and deep learning

• Develop open‑source software to serve inference of trained AI models running on GPUs
• Build robust, scalable, high‑performance software components for distributed inference workloads
• Collaborate with team leads to prioritize features and capabilities
• Load‑balance asynchronous requests across available resources while optimizing prediction throughput
• Integrate the latest open‑source technology into existing systems

• Master's or PhD degree or equivalent experience
• 8+ years of experience in Computer Science, Computer Engineering, or a related field
• Strong programming and software design skills in Rust, Python, and C++
• Ability to work in a fast‑paced, agile team environment
• Experience with high‑scale distributed systems and machine learning systems

• Prior experience improving the performance of AI inference systems
• Background in deep learning algorithms and frameworks, particularly with Large Language Models
• Experience building and deploying cloud services using technologies such as HTTP REST, gRPC, and JSON
• Familiarity with the latest AI research and knowledge of efficient implementation of such systems

We prioritize candidate privacy and champion equal‑opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately.

We are not the EOR (Employer of Record) for this position. Our role in this specific opportunity is to connect outstanding candidates with a top‑tier employer.