Staff Software Engineer, Lakeflow Pipelines DR

Job Description

Design and implement distributed systems to replicate and recover Lakeflow pipelines across cloud regions. Focus on solving challenges related to consistency, idempotency, and failover to prevent data loss or duplication.

Requirements: Requires 8+ years of experience in distributed systems or reliability engineering with strong proficiency in languages like Java, Scala, or Go. Candidates should have a deep understanding of transactions, replication, and the ability to drive a multi-year technical vision.

Key Skills: Distributed Systems, Java, Scala, C++, Go, Python, Replication, Checkpointing, Data Lineage, Idempotency, Consistency, Reliability Engineering, Database Design, Streaming Systems, Failover Recovery, Transaction Metadata

Benefits: Annual performance bonus, Equity