Senior Software Engineer, AI Data

Job Description

Design and build a multi-cloud AI data platform that places, caches, streams, and manages datasets, checkpoints, and scratch data across storage systems, Kubernetes, and Slurm. Own data quotas, lifecycle, telemetry, capacity planning, and production reliability for workloads spanning large GPU fleets.

Requirements: Requires a bachelor's or master's degree in a relevant engineering or computer science field, or equivalent experience, and at least five years building production systems or data-infrastructure software. Candidates need deep experience with distributed file systems, large-scale object storage, or data pipelines, strong I/O performance knowledge, proficiency in Go, Rust, C or C++ and Python, and a record of improving production services.

Key Skills: Distributed Storage Systems, Object Storage, Data Pipelines, I/O Performance Optimization, Go, Rust, C, C++, Python, Kubernetes, Slurm, AI Training Data, Checkpoint Management, Distributed Caching, Quota Management, Production Service Ownership

Benefits: Equity, Benefits