Sr. Software Engineer, Data Processing OSS

Job Description

Architect and develop integrations between DataPelago’s data processing engine and open-source platforms such as Apache Gluten, Velox, Spark, and Flink, improving functionality, performance, scale, and reliability. Collaborate with engineering, product, open-source communities, and customer success teams while contributing to design reviews, testing, CI/CD, and product quality.

Requirements: Requires 12+ years of relevant experience and a bachelor’s or master’s degree in computer science or a related field. Candidates should have deep experience developing and optimizing large-scale data processing platforms, knowledge of Spark, Flink, or Presto/Trino internals, strong C, C++, and Java skills, and extensive Linux development experience.

Key Skills: C, C++, Java, Linux, Apache Spark, Apache Flink, Apache Gluten, Velox, Data Processing, Performance Optimization, Distributed Systems, Parallel Processing, Query Optimization, Open-Source Software Development, Benchmarking, CI/CD

Benefits: Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, Leave Options, Performance-Based Incentives, Employee Stock Purchase Plan, Restricted Stock Units