Lead Software Engineer, ML Network Stack - Annapurna Labs

Job Description

Lead the development of the network stack for EC2 distributed AI/ML systems, specifically enabling NVIDIA GPUs to work with AWS machines. Direct a team of software engineers to deliver features required for the largest AI models and ML workloads.

Requirements: Requires 5+ years of experience in system design, software development life cycle, and programming in C or C++. Candidates must have experience as a tech lead or mentor and preferably have knowledge of ML communication libraries or RDMA networking.

Key Skills: C, C++, ML Networking, RDMA, NCCL, NVSHMEM, NIXL, CUDA Kernels, Linux, Distributed Systems, System Architecture, Software Development Life Cycle, HPC, Embedded Systems, Technical Leadership, Network Stack

Benefits: Sign-on Payments, Restricted Stock Units (RSUs), Health Insurance, Medical Insurance, Dental Insurance, Vision Insurance, Prescription Insurance, Basic Life & AD&D Insurance, Supplemental Life Plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement, 401(k) Matching, Paid Time Off, Parental Leave