Principal Software Engineer, Data Processing OSS

Job Description

Architect and develop integrations and enhancements for the DataPelago engine and open-source data processing platforms, including Apache Gluten and Velox. Optimize and maintain engine components, contribute to upstream and downstream projects, and collaborate with engineering, product, community, and customer success teams.

Requirements: Requires 15+ years of relevant experience and a bachelor's degree in computer science or a related field, or a master's degree in the same fields. Candidates should have at least three years of deep experience developing core components of large-scale data processing platforms and optimizing engine performance, along with strong C, C++, Java, and Linux skills.

Key Skills: C, C++, Java, Linux, Apache Spark, Apache Flink, Apache Gluten, Velox, Distributed Systems, Data Processing, Performance Optimization, Parallel Processing, Query Optimization, Hardware-Accelerated Computing, Open-Source Software Development, CI/CD

Benefits: Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, Leave Options, Performance-Based Incentives, Employee Stock Purchase Plan, Restricted Stock Units