Lead Software Engineer - Databricks, Spark, AWS

Job Description

Lead the architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Apache Spark. Oversee the setup and optimization of Databricks clusters and ensure compliance with organizational policies.

Requirements: Candidates should have formal training or certification in software engineering concepts and at least 10 years of professional software/data engineering experience. Strong proficiency in Python and/or Java, along with hands-on expertise in Databricks and AWS services, is required.

Key Skills: Databricks, Apache Spark, AWS, Python, Java, ETL, Data Engineering, Cloud Computing, Data Pipelines, Data Governance, CI/CD, Performance Tuning, Data Modeling, Security, Incident Response, Automation

Benefits: Health Care Coverage, On-Site Health and Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching