Director, Software Engineer Data Processing Engine Orchestration

Job Description

Lead and grow the engineering team responsible for orchestration capabilities, including planning, optimizing, and coordinating complex workloads across distributed data processing systems. Deliver product roadmap capabilities while improving product quality, performance, scale, reliability, development practices, and collaboration with open-source communities and business stakeholders.

Requirements: Requires a bachelor’s degree in computer science or a related field, with a master’s or PhD preferred, plus 12+ years of production software development and 7+ years managing software teams. Candidates should have 10+ years building and supporting massively parallel data processing platforms, deep expertise in database or query systems, and strong leadership, customer engagement, and operational skills; experience with relevant Apache and Velox technologies is preferred.

Key Skills: Team Leadership, Software Development, Data Processing Engine Orchestration, Query Planning, Query Optimization, Distributed Systems, Massively Parallel Processing, Apache Spark, Apache Flink, Apache Gluten, Velox, Apache DataFusion, Spark RAPIDS, Cloud Data Warehouses, Performance and Reliability Engineering, AI Adoption

Benefits: Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, Leave Options, Performance-Based Incentives, Employee Stock Purchase Plan, Restricted Stock Units