[Job -29790] Senior Data Engineer | (Spark + Databricks)

Job Description

We are **tech transformation**specialists, uniting human expertise with AI to create scalable tech solutions.With over 8,000 CI\&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.

At CI\&T, we don't just deliver digital experiences; we engineer quality into every product we ship. As part of our dynamic team, you'll have the opportunity to safeguard the reliability, performance, and usability of end-to-end digital solutions for a diverse clientele, including some of Australia's most well-known brands.

This role offers a unique opportunity to contribute to a major enterprise client's strategic initiative. You'll embed automated testing, AI-assisted workflows, and modern test tooling into our delivery lifecycle, partnering across mobile, web, and platform teams to ensure quality is built in --- not bolted on.

The ideal candidate will be part of a CI\&T team working directly with clients. They will bring deep expertise in automated testing, hands-on experience with Playwright (web) and Maestro (mobile), and a working command of AI-driven workflows that accelerate test design, generation, and maintenance.

You will play a key role in defining test strategy, building automation frameworks, and validating quality across modern web applications, mobile apps, and broader digital ecosystems; projects that demand rigour.

\\n

\\n
?0 - ?0 a month

**Job Responsibilities:** Design, develop, and maintain scalable data pipelines and ETL workflows.  

* Build and optimize data storage solutions, including data warehouses and data lakes.
* Work closely with data scientists and analysts to fulfill data requirements and facilitate efficient data access.
* Ensure system-wide data quality, consistency, and reliability.
* Develop and maintain robust data models and table structures.
* Implement comprehensive data security measures and access controls.
* Optimize SQL queries and enhance data retrieval performance.
* Research, evaluate, and integrate new data technologies and tools.
* Mentor junior data engineers and provide technical leadership within the team.
* Collaborate cross-functionally to support data-driven business decision-making.

**Qualifications \& Requirements**  

* Bachelor's degree or higher in Computer Science or a related field.
* At least 5 years of relevant experience in data engineering.
* Proficiency in at least one of the following programming languages: Python, Java, or Scala.
* Extensive hands-on experience with big data technologies such as Hadoop, Spark, and Hive.
* Strong expertise in SQL and familiarity with both relational and NoSQL databases.
* Proven experience working with cloud platforms such as AWS and Azure, including their native data services.
* Solid understanding of data modeling, data warehousing, and ETL best practices.
* Strong logical reasoning, attention to detail, and problem-solving skills.
* Excellent communication and collaboration abilities.

**Preferred Qualifications (Bonus Points)**  

* Experience with stream processing frameworks such as Kafka, Flink, or Delta Live Tables.
* Familiarity with data governance and regulatory compliance requirements.
* Experience with containerization technologies, including Docker and Kubernetes.
* Active contributions to open-source projects or possession of relevant technical certifications.
* Previous experience using the Tencent Big Data platform.
* Proficiency in Power BI for analytics, dashboard development, and reporting.
\\n

### Benefits \& Perks

* **Allowance:** ?5,000 (taxable and non-taxable)
* **Paid Leaves:**

* Year 1: 12 Vacation Leaves (VL) and 10 Sick Leaves (SL)

* Year 2 onwards: 20 VL and 10 SL
* **Leave Conversion:** Up to 5 unused vacation leaves may be converted or carried over
* **HMO Coverage:** Up to ?250,000 per illness per year, with 2 free dependents
* **Referral Program:** Incentives for successful talent referrals
* **Pantry Perks:** Complimentary coffee, milk, chocolate, and snacks
* **Company Engagement:** Quarterly company-sponsored meals (Happy Hour)

Collaboration is our superpower, diversity unites us, and excellence is our standard.

We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.