Software Engineer, SystemML - AI Networking

Job Description

Provide technical leadership for development of the collective communication library used across Meta’s large-scale GPU training infrastructure, with a focus on GenAI and LLM scaling. Develop and improve NCCL- and PyTorch-related features, benchmarks, performance tuners, and software stacks to increase the reliability and performance of distributed machine learning workloads.

Requirements: A bachelor’s degree in computer science, computer engineering, a related technical field, or equivalent practical experience is required, along with proven C/C++ and Python skills and a record of leading successful projects. Candidates should have experience leading cross-functional technical projects and specialized expertise in at least one relevant area, such as distributed ML training, GPU architecture, ML systems, AI infrastructure, HPC, performance optimization, or ML frameworks.

Key Skills: C/C++, Python, NCCL, Distributed Machine Learning Training, GPU Architecture, Machine Learning Systems, AI Infrastructure, High-Performance Computing, Performance Optimization, PyTorch, CUDA, RoCE, InfiniBand, Distributed GPU Performance Analysis, Technical Leadership, Cross-Functional Project Leadership

Benefits: Bonus, Equity, Benefits