Sr. Software Development Engineer, Annapurna Labs

Sr. Software Development Engineer, Annapurna Labs

In this role you will be responsible for leading a technical team that provides profiling and optimization tools for the Neuron ML accelerators fleet. You will work closely with the hardware and software teams to ensure that the right tools are available for performance profiling of large ML workloads, identifying bottlenecks and automatically providing improvement recommendations. Neuron Core Tools develops and maintains a family of profiling software and provides performance engineers with the ability to develop and improve custom kernels that impact the efficiency of large workloads.

• Provide technical leadership to the Neuron Core Tools team.
• Work closely with the frameworks and compiler teams.
• Collect requirements from various other teams including training, inference, and runtime.
• Collaborate with the compiler performance team to ensure timely release of the core performance tools.
• Anticipate future needs based on the product roadmap and develop necessary tools to increase efficiency in large‑scale compute.

Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge‑sharing and mentorship. Senior members enjoy one‑on‑one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our members develop their engineering expertise so you feel empowered to take on more complex tasks in the future.

AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

Here at AWS, it’s in our nature to learn and be curious. Our employee‑led affinity groups foster a culture of inclusion that empowers us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and Amaze Con conferences, inspire us to never stop embracing our uniqueness.

We value work‑life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.

We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge‑sharing, mentorship and other career‑advancing resources here to help you develop into a better‑rounded professional.

Amazon Annapurna Labs team (our organization within AWS UC) is responsible for building innovation in silicon and software for our AWS customers. We are at the forefront of innovation by combining cloud scale with the world’s most talented engineers. Our team covers multiple disciplines including silicon engineering, hardware design, software and operations. Because of our breadth of talent, we have been able to improve AWS cloud infrastructure in high‑performance machine learning with AWS Neuron, Inferentia and Trainium ML chips, in networking and security with products such as AWS Nitro, Enhanced Network Adapter (ENA), and Elastic Fabric Adapter (EFA), and in computing with AWS Graviton and F1 EC2 instances.

AWS Utility Computing (UC) provides product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services. Additionally, this role may involve exposure to and experience with Amazon’s growing suite of generative AI services and other cloud computing offerings across the AWS portfolio.

Amazon Web…