Senior Software Engineer, AI Data

Job Description

Design and build a multi-cloud AI data platform that places, caches, streams, and manages datasets, checkpoints, and scratch data across storage systems for large GPU workloads. Own Kubernetes-native integrations, quotas and data lifecycle, I/O telemetry, capacity planning, and production reliability, including on-call and incident prevention.

Requirements: Requires a bachelor's or master's degree in computer science, computer engineering, electrical engineering, or a related field, or equivalent experience, plus at least five years building production systems or data-infrastructure software. Candidates need deep experience with distributed file systems, large-scale object storage, or data pipelines; strong I/O performance knowledge; proficiency in Go, Rust, C, or C++ and Python; and a record of improving production services.

Key Skills: Distributed Storage Systems, Object Storage, Data Pipelines, I/O Performance, Go, Rust, C, C++, Python, Kubernetes, Slurm, AI Training Data, Distributed Caching, Checkpoint Management, Quota Management, Production Reliability

Benefits: Equity, Benefits