Software Engineer III - Python, Databricks and AWS

Job Description

The role involves building and maintaining scalable data collection, storage, and analytics solutions using Databricks and AWS. Key duties include implementing resilient ingestion pipelines, ensuring data governance, and optimizing Spark workloads for performance and cost.

Requirements: Candidates need 3+ years of SDLC experience with a strong focus on data engineering and the Databricks Lakehouse on AWS. Proficiency in Spark, Delta Lake, and AWS fundamentals, along with experience using AI-assisted coding tools, is required.

Key Skills: Python, Databricks, AWS, Spark, Delta Lake, Data Engineering, Terraform, CI/CD, Structured Streaming, Unity Catalog, SQL, AI-assisted development, Data Governance, Infrastructure as Code, Unit Testing, Performance Tuning

Benefits: Health care coverage, On-site health and wellness centers, Retirement savings plan, Backup childcare, Tuition reimbursement, Mental health support, Financial coaching