Lead Software Engineer - Data Engineering | Data Technology

Job Description

Design, develop, and optimize large-scale ETL pipelines and distributed data processing solutions using Python, PySpark, AWS services, Snowflake, and modern data lake formats. Lead engineering quality through testing, code reviews, CI/CD, workflow orchestration, and responsible use of approved AI-assisted development tools.

Requirements: Requires formal training or certification in software engineering concepts and at least five years of applied experience, with a strong focus on data engineering. Candidates should have experience with Python, PySpark, DBT, AWS data services, workflow orchestration, Snowflake, SQL, and modern data lake formats; streaming technologies, AI/ML, financial services, and mentoring experience are preferred.

Key Skills: Python, Java, PySpark, DBT, ETL Development, Apache Airflow, Control-M, AWS Data Services, Snowflake, SQL, Iceberg, Delta Lake, CI/CD, Automated Testing, AI-Assisted Development, Data Pipeline Engineering

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching, Commission-Based Pay (Eligible Roles), Discretionary Incentive Compensation