Senior Deep Learning Software Engineer, Inference

Employer Industry:
Technology - Artificial Intelligence and High-Performance Computing

Why consider this job opportunity:

• Base salary range of $148,000 - $287,500, determined by location and experience
• Opportunity for equity and comprehensive benefits
• Work alongside leading professionals in AI and technology
• Contribute to cutting‑edge projects in Deep Learning and AI frameworks
• Engage in a collaborative environment that values innovation and diversity
• Chance to influence the direction of high‑performance deep learning technologies

• Optimize performance, analysis, and tuning of deep learning models in various domains such as LLM, Multimodal, and Generative AI
• Scale performance of deep learning models across different architectures and types of accelerators
• Contribute features and code to the employer’s inference libraries and software solutions
• Collaborate with cross‑functional teams on frameworks and innovative inference optimization solutions
• Implement and optimize model serving pipelines using open-source tools and plugins

• Master’s or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, or AI
• 5+ years of relevant software development experience
• Excellent C/C++ programming and software design skills
• Experience with training, deploying, or optimizing deep learning models in production
• Background in performance modeling, profiling, debugging, and code optimization

• Contributions to Deep Learning Software projects such as PyTorch, vLLM, or SGLang
• Experience with Multi‑GPU communications (NCCL, NVSHMEM)
• Experience in building and shipping products to enterprise customers
• GPU programming experience (CUDA, OAI TRITON, or CUTLASS)

#Artificial Intelligence #Deep Learning #Software Engineering #High Performance Computing  #Career Opportunity

We prioritize candidate privacy and champion equal‑opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately. We are not the EOR (Employer of Record) for this position.

Our role in this specific opportunity is to connect outstanding candidates with a top‑tier employer.