Lead Software Engineer - Databricks/Spark/AWS

Job Description

Lead the architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Apache Spark. Drive team adoption of AI-assisted engineering practices to improve code quality and operational outcomes.

Requirements: Candidates must have 10+ years of professional software/data engineering experience, including substantial production work with Spark on Databricks or EMR. Strong proficiency in Python and/or Java, along with hands-on Databricks expertise and solid AWS experience, is required.

Key Skills: Databricks, Apache Spark, AWS, Python, Java, ETL, CI/CD, Data Engineering, AI-assisted Development, Data Quality, Performance Tuning, SQL, CloudWatch, Kinesis, Terraform, Data Governance

Benefits: Health Care Coverage, On-site Health and Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching