Sr. Software Engineer, Pretraining Data

Job Description

Design and scale distributed data platforms, pipelines, and web-crawling systems that transform raw web, code, multimodal, and acquired data into high-quality datasets for frontier model pretraining. Lead cross-team technical initiatives, improve data quality and pipeline reliability, and mentor engineers while measuring the impact of data improvements on model performance.

Requirements: Requires at least five years of professional software engineering experience building distributed systems and/or large-scale data infrastructure. Preferred qualifications include strong infrastructure expertise, end-to-end ownership, independent debugging, cross-team technical leadership, mentoring, and experience operating reliable systems at frontier scale.

Key Skills: Distributed Systems, Large-Scale Data Infrastructure, Data Platform Engineering, Data Pipeline Development, Data Quality, Web Crawling, Data Classification, Data Deduplication, Data Filtering, Data Sampling, Pipeline Orchestration, System Architecture, Technical Leadership, Project Leadership, Mentoring, Model Pretraining

Benefits: Equity, Medical Insurance, Vision Insurance, Dental Insurance, 401(k) Retirement Plan, Short-Term Disability Insurance, Long-Term Disability Insurance, Life Insurance, Discounts And Perks