Principal Software Engineer, Data Processing Optimization

Job Description

Research, design, implement, and deliver logical and physical query-plan optimization for large-scale data processing engines, integrating DataPelago acceleration with open-source platforms such as Spark and Flink. Lead major product capabilities, improve performance and reliability in customer deployments, collaborate across engineering and product teams, and mentor junior engineers.

Requirements: A bachelor's degree in computer science is required, with a master's or PhD preferred, and 15+ years of experience developing query planning and optimization for enterprise data-processing platforms. Candidates should have deep SQL and database expertise, preferably 5+ years on parallel platforms such as Spark, Presto/Trino, or Flink, along with experience delivering enterprise software and providing technical leadership.

Key Skills: Query Planning, Query Optimization, SQL Processing, Python Processing, Parallel Data Processing, Apache Spark, Apache Flink, Presto/Trino, Distributed Systems, Database Systems, Data Warehousing, Heterogeneous Computing, CPU and GPU Acceleration, Software Development, Technical Leadership, AI Adoption

Benefits: Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, Leave Options, Performance-Based Incentives, Employee Stock Purchase Plan, Restricted Stock Units