Lead Software Engineer - DataBricks, Spark, Terraform (Corporate - Employee Platforms)

Job Description

Lead the technical roadmap and architecture for the Databricks lakehouse platform, including data ingestion, modeling, governance, security, reliability, performance, and cost management. Establish engineering standards and operational practices, mentor engineers, and guide teams in the safe, effective use of approved AI-assisted development tools.

Requirements: Requires 7+ years of data or platform engineering experience, production Databricks expertise, strong Spark and SQL skills, and experience building, operating, and optimizing data platforms. Candidates should also demonstrate software engineering, governance, observability, technical leadership, and responsible AI-assisted development practices; Terraform and other listed platform features are preferred.

Key Skills: Databricks, Apache Spark, PySpark, Scala, SQL, Terraform, Delta Lake, Unity Catalog, Data Engineering, Data Modeling, Data Governance, Performance Tuning, CI/CD, Automated Testing, Data Observability, AI-Assisted Development

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching