Member of Technical Staff, Software Engineer (Data Infrastructure)

Job Description

You will design and own the data infrastructure platform for multimodal capture, including ingest, storage, indexing, and delivery. Your work ensures that massive datasets are durable, queryable, and performant enough to support large-scale distributed training runs.

Requirements: Candidates must have at least 3 years of experience building production-grade data infrastructure with strong proficiency in Python and systems programming. You should possess deep expertise in storage layout, distributed processing frameworks, and data reproducibility at scale.

Key Skills: Data infrastructure, Python, Systems programming, Storage architecture, Distributed processing, Ray, Spark, Data indexing, Data versioning, Video processing, Sensor data, Schema evolution, Performance optimization, Data lineage, Distributed training