Senior Software Engineer, AI Data

Job Description

Design and build a multi-cloud AI data platform for GPU workloads, including data placement, caching, streaming, checkpointing, Kubernetes integrations, quotas, and lifecycle management. Measure and improve data access and reliability through telemetry, capacity planning, incident response, and prevention of storage-related failures.

Requirements: Requires a bachelor's or master's degree in a relevant engineering or computer science field, or equivalent experience, and at least five years building production systems or data-infrastructure software. Candidates need deep experience with distributed or object storage or large-scale data pipelines, strong I/O performance knowledge, proficiency in Go, Rust, C, or C++ plus Python, and a record of improving production services.

Key Skills: Distributed Storage Systems, Object Storage, Data Pipelines, I/O Performance, Go, Rust, C, C++, Python, Kubernetes, Slurm, AI Training Data, Distributed Caching, Checkpoint Management, Quota and Capacity Management, I/O Telemetry

Benefits: Equity, Benefits