Lead Software Engineer- Financial Services Data Engineering: Pyspark / Java / BigData / Datalake / AI

Job Description

Lead modernization of analytics and data engineering on the strategic data mesh, defining an AI-driven data product lifecycle and building human-in-the-loop agents for data quality, schema changes, incident triage, and governance. Provide technical leadership, improve engineering practices with approved AI-assisted tools, and deliver scalable analytics platforms with strong monitoring, lineage, and regulatory controls.

Requirements: Requires at least five years of applied software engineering experience, with leadership delivering AI-first analytics and data engineering at scale. Candidates should have hands-on experience with modern big data platforms and Python/PySpark or Java, plus expertise in AI/ML, data governance, CI/CD, secure AI-assisted development, and the software development lifecycle.

Key Skills: Python, PySpark, Java, Apache Spark, Databricks, Snowflake, Apache Iceberg, Big Data Engineering, Data Mesh, Data Lakehouse, Machine Learning, Natural Language Processing, Large Language Models, Agentic Frameworks, Data Governance, CI/CD

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching