Lead Software Engineer - Databricks (Corporate Technology)

Job Description

Architect and operate secure, scalable Databricks Lakehouse platforms on AWS, delivering batch and streaming data pipelines, governance, and reliable production workloads. Lead engineering standards and design reviews, mentor engineers, and coordinate with stakeholders and security and platform teams to deliver maintainable, cost-effective data solutions.

Requirements: Requires 7+ years of data engineering experience, including 2+ years leading delivery or architecture for multi-team data platforms, with hands-on Databricks, Delta Lake, Spark, and AWS expertise. Candidates should also have experience with governance, production reliability, CI/CD and Terraform, testing, performance and cost optimization, and technical leadership.

Key Skills: Data Engineering, Databricks, AWS, Delta Lake, Apache Spark, Structured Streaming, Data Pipeline Architecture, Data Governance, Unity Catalog, Terraform, CI/CD, Data Quality Testing, Incident Response, Performance And Cost Optimization, Technical Leadership, Mentoring

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching