Senior System Software Engineer - Dynamo and Triton Inference Server

Senior System Software Engineer - Dynamo and Triton Inference Server

NVIDIA is hiring a Senior System Software Engineer to work on Dynamo & Triton Inference Server. This role builds backend services and software for GPU-accelerated deep learning.

• Develop open source software to serve inference of trained AI models running on GPUs.
• Build robust, scalable, high-performance components for distributed inference workloads.
• Collaborate with team leads to prioritize features and capabilities.
• Load‑balance asynchronous requests across resources to optimize prediction throughput while meeting latency constraints.
• Integrate the latest open‑source technology.

• Masters or PhD or equivalent experience.
• 8+ years in Computer Science, Computer Engineering, or related field.
• Ability to work in a fast‑paced, agile team environment.
• Excellent Rust, Python, or C++ programming and software design skills, including debugging, performance analysis, and test design.
• Experience with high‑scale distributed systems and ML systems.

• Prior work improving performance of AI inference systems.
• Background with deep learning algorithms and frameworks, especially Large Language Models, PyTorch, Tensor
  
  RT, and ONNX Runtime.
• Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, and JSON.
• Familiarity with the latest AI research and practical knowledge of efficient implementations.

Base salary range:
Level 4 – $184,000 – $287,500, Level 5 – $224,000 – $356,500 USD, plus equity and benefits.

Applications accepted until January 13, 2026.

NVIDIA is committed to fostering a diverse work environment and is an equal‑opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

NVIDIA uses AI tools in its recruiting processes.