Senior Software Engineer

Job Description

Lead the design, development, and maintenance of scalable data quality frameworks, validation pipelines, and ETL/ELT workflows using Python, Spark, Hadoop, Airflow, and NiFi. Establish data quality standards and monitoring, resolve data issues, mentor engineers, collaborate with stakeholders, and document system architecture and quality metrics.

Requirements: Requires a bachelor's or master's degree in Computer Science, Engineering, or a related field, along with data engineering experience and at least five years of software development experience, including two years in a senior or lead role. Candidates should have strong Python skills, hands-on Spark and Hadoop experience, Airflow and NiFi expertise, and knowledge of data quality, CI/CD, Jenkins, Oracle, Power BI, and Splunk; cloud experience is a plus.

Key Skills: Python, Apache Spark, Hadoop, Apache Airflow, Apache NiFi, Data Quality Automation, CI/CD, Jenkins, Oracle, Power BI, Splunk, ETL/ELT, Data Validation, Data Engineering, Distributed Systems, Cloud Platforms