Principal Software Engineer, Data Processing OSS

NetApp
US - California - San Jose
View Company Profile / << Go Back

  • Job Type: Full time
  • 20 days ago

Job Description

Architect and develop integrations between DataPelago’s data processing engine and open-source platforms such as Apache Gluten, Velox, Spark, and Flink, improving functionality, performance, scale, and reliability. Lead design and implementation of engine components, identify opportunities for product differentiation, collaborate with engineering and open-source communities, and promote strong development and quality practices.

Requirements: Requires 15+ years of relevant experience and a bachelor’s degree in computer science or a related field, or a master’s degree in the same fields. Candidates should have deep experience developing core components of large-scale data processing platforms and optimizing engine performance, strong knowledge of Spark, Flink, or Presto/Trino internals, production engine release experience, and exceptional C, C++, and Java skills.

Key Skills: C, C++, Java, Linux, Apache Spark, Apache Flink, Apache Gluten, Velox, Data Processing, Distributed Systems, Performance Optimization, Query Optimization, Parallel Processing, Open-Source Software Development, CI/CD, Code Review

Benefits: Health Insurance, Life Insurance, Retirement or Pension Plans, Paid Time Off, Leave Options, Performance-Based Incentives, Employee Stock Purchase Plan, Restricted Stock Units




Fast Track Upload