Senior Lead Software Engineer - Data & AI Platform Engineer

Job Description

Lead the design and delivery of scalable data pipelines and governed data platform capabilities, including cataloging, lineage, data quality, and analytics-ready data models. Drive an Agentic AI lakehouse initiative to automate platform provisioning and operations, while partnering with product, analytics, and business teams to deliver secure, reliable production solutions.

Requirements: Requires at least five years of applied software engineering experience, strong programming skills in Python, Java, or SQL, and hands-on experience with distributed data processing, Databricks, orchestration, cloud data services, and production data platforms. Candidates should also understand data modeling, query optimization, CI/CD, resiliency, and security; experience with Agentic AI, LLMs, RAG, MCP, vector databases, and embedding-based retrieval is specified.

Key Skills: Python, Java, SQL, Apache Spark, Apache Flink, Databricks, Apache Airflow, AWS Data Services, Kubernetes, Data Modeling, Data Pipelines, Agentic AI, Large Language Models, Retrieval-Augmented Generation, CI/CD, Terraform

Benefits: Health Care Coverage, On-Site Health And Wellness Centers, Retirement Savings Plan, Backup Childcare, Tuition Reimbursement, Mental Health Support, Financial Coaching