Senior Software Engineer, AI Data

Job Description

Design and build a multi-cloud AI data platform that places, caches, streams, and manages datasets, checkpoints, and scratch data across storage systems for GPU workloads. Develop Kubernetes-native integrations, quotas and lifecycle controls, I/O telemetry, and reliability improvements for research teams using Slurm and Kubernetes.

Requirements: Requires a bachelor's or master's degree in a relevant engineering or computer science field, or equivalent experience, and at least five years building production systems or data-infrastructure software. Candidates need deep experience with distributed file systems, large-scale object storage, or data pipelines, strong programming skills in Go, Rust, C, or C++ plus Python, and a record of improving production services.

Key Skills: Go, Rust, C, C++, Python, Kubernetes, Slurm, Distributed File Systems, Object Storage, Data Pipelines, I/O Performance, Distributed Caching, AI Training Data, Checkpoint Management, Quota and Capacity Management, Production Service Reliability

Benefits: Equity, Benefits