Staff Software Engineer - Compiler & Spark Runtime

Job Description

Lead the design, implementation, and production rollout of compiler and runtime capabilities that translate Spark workloads into efficient Snowflake execution, including query compilation, semantic compatibility, and performance improvements. Provide hands-on technical leadership through architectural decisions, code and design reviews, production issue investigation, mentorship, and cross-team prioritization.

Requirements: Requires 10+ years of hands-on software engineering experience, substantial expertise in compilers, query processing, or runtime infrastructure, and a record of technically leading complex production initiatives. Candidates should be proficient in Scala, Java, C++, or a comparable language, with strong systems and performance fundamentals, and effective communication and mentorship skills.

Key Skills: Compiler Architecture, Spark Runtime Integration, Intermediate Representations, Type Systems, Query-Plan Transformations, SQL Generation, Apache Spark, Relational Query Processing, Scala, Java, C++, Performance Analysis, Differential Testing, Production Observability, Technical Leadership, Mentorship

Benefits: Medical Insurance, Dental Insurance, Vision Insurance, Life Insurance, Disability Insurance, 401(k) Retirement Plan, Flexible Spending Account, Health Savings Account, Paid Holidays, Paid Time Off, Parental Leave, Employee Assistance Program, Bonus Plan, Equity Plan