Software Engineer (Ray Data)

Job Description

Improve the performance of Ray Data and multi-modal batch inference while ensuring efficient scaling across data pipelines. Focus on building stable, fault-tolerant data loading solutions for production training workloads and scaling AI workloads for customers.

Requirements: Requires 3-4 years of relevant work experience with a solid background in building scalable and fault-tolerant distributed systems. Candidates should have experience with data processing and database internals and a passion for large-scale AI performance.

Key Skills: Distributed Systems, Data Processing, Database Internals, Python, Scalable Systems, Fault Tolerance, Machine Learning, AI Workloads, Batch Inference, Data Pipelines