Software Engineer: IV (Lead)

Job Description

Develop and manage real-time streaming pipelines using Confluent Kafka and Apache Flink, integrating data sources with platforms such as AWS and Snowflake while maintaining data quality and reliability. Automate infrastructure and deployments with Terraform and CI/CD, optimize pipeline performance, and support teams with Kafka guidance and troubleshooting.

Requirements: Requires at least three years of software development experience focused on Apache Kafka and distributed systems, including at least two years of Python experience, plus hands-on experience with Confluent Kafka, Schema Registry, Terraform, and AWS. Preferred qualifications include Confluent Cloud, Apache Flink, ksqlDB, Kafka Connect, Snowflake, Java, cloud-native DevOps tools, and relevant certifications.

Key Skills: Apache Kafka, Confluent Cloud, Python, Distributed Systems, Apache Flink, Terraform, AWS, Schema Registry, Data Integration, ETL, Data Pipeline Orchestration, CI/CD, Operational Monitoring, Snowflake, Java, Kafka Connect