Lead Software Engineer

JPMorganChase
US - Texas - Plano
View Company Profile / << Go Back

  • Job Type: Full time
  • 5 days ago

Job Description

Lead the architecture, development, and operation of scalable batch and streaming data pipelines on Databricks, optimizing Spark performance, reliability, governance, and cost. Establish engineering standards and CI/CD practices, manage platform configuration and infrastructure, and guide the safe, validated use of approved AI-assisted development tools.

Requirements: Requires formal training or certification in software engineering concepts and at least five years of applied experience, including production data engineering with Spark on Databricks or AWS EMR. Candidates should have advanced Databricks, Python, SQL, pipeline architecture, performance tuning, security, and responsible AI experience, along with the ability to set standards and coach engineers.

Key Skills: Apache Spark, Databricks, Delta Lake, Python, SQL, Data Engineering, ETL/ELT Pipelines, Spark Performance Tuning, Unity Catalog, AWS, Terraform, Airflow, CI/CD, Data Modeling, AI-Assisted Software Development, Data Governance

Benefits: Health Care Coverage, On-Site Health and Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching




Fast Track Upload