Software Engineer, Accelerator Portability

About Modular

At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting‑edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.

If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.

ML developers today face significant friction in taking trained models into deployment. They work in a highly fragmented space, with incomplete and patchwork solutions that require significant performance tuning and non‑generalizable/ model‑specific enhancements. At Modular, we are building the next generation AI platform that will radically improve the way developers build and deploy AI models.

As part of our mission to build AI’s unified compute layer, we are expanding the Modular software stack to a variety of new (and exciting) hardware platforms.

We are looking for experienced engineers to join the Hardware Enablement team  this role you will be responsible for integrating new accelerators throughout Modular software stack, from the mojo compiler, MAX model serving and Mammoth. A core part of our work involves close collaboration with both internally and externally to ensure seamless support for new platforms, and help our software stack to be portable across multiple hardware architectures.

Candidates authorized to work and based in the UK are welcome to apply. You can work in our office in Edinburgh, UK or remotely from home.

• Work closely with internal and external teams to add support for new Hardware Architectures
• Architect full‑stack solutions from Mojo Kernels to graph compiler, delivering state‑of‑the‑art performance on novel architectures
• Contribute to a cross team effort to improve portability and tooling for performance and functionality debugging and analysis on different target hardware.
• Collaborate with the product teams and engage with Hardware vendors to understand their target hardware and how to best map it to various customer use‑cases.
• Regularly share knowledge and findings with the rest of the team and the company, fostering a cooperative and open environment, via demos, presentations and participating on company events like on sites and hackathons.
• Mentor engineers on diverse hardware architectures, optimization techniques, and portable programming patterns.
• Develop and disseminate deep expertise in new hardware platforms, partnering with Mojo kernel developers to achieve state‑of‑the‑art performance on the latest hardware.

• 8+ years of experience working on high performance computing systems or relevant domains in industry or research.
• Proven experience in technical leadership in relevant domains
• Knowledge of AI framework implementation and architecture, and how operators are implemented (e.g. experience writing custom Triton operators)
• Experience with modern GPU based DSL/DSEL (eg. cutlass/triton/cute
  
  DSL)
• Experience in C++ programming and complex software systems.
• Experience working with CUDA/SYCL/OpenCL or other heterogeneous programming models, both as a user and as an implementor
• Strong understanding of non‑GPU architectures, like DSPs, NPUs or any other hardware accelerator beyond GPUs
• Creativity and curiosity for solving complex problems, a team‑oriented attitude that enables you to work well with others, and alignment with our culture.

• Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
• World‑class Benefits. In order to attract the best, we need to offer the best. Premier insurance plans, flexible paid time off, and more are available to you! Please note that specific benefit packages may vary based on your location.
• Competitive Compensation. We…