Member of Technical Staff (Software Engineer, Inference & Training Platform)

Job Description

The role involves building a self-serve compute platform for training and inference workloads while managing a GPU fleet across multiple cloud providers. Responsibilities also include ensuring reliability, fault tolerance, and efficient resource allocation.

Requirements: Candidates should have deep experience with Kubernetes, GPU clusters, and distributed systems fundamentals. Proficiency in programming languages such as Go, Rust, or C++ is also required, along with experience in managing both training jobs and inference services.

Key Skills: Kubernetes, GPU Clusters, CUDA, Networking, Distributed Systems, Go, Rust, C++, Inference Services, Training Jobs, Fault Tolerance, Autoscaling, Observability, Scheduling, Resource Allocation, Multi-Cloud