Python Data Engineer

Job Description

We're looking for a **Python Software Engineer with Data Engineering experience** to join a global team building a large-scale Metering Data Platform. This is **not a traditional Data Engineer role focused solely on Databricks notebooks and ETL development**. The ideal candidate has a strong software engineering foundation and enjoys building scalable, production-grade applications.

What You'll Do

* Build and maintain Python-based applications, APIs, and data services.
* Develop scalable data ingestion and processing solutions using PySpark and Databricks.
* Create reusable frameworks, CI/CD processes, monitoring, and testing capabilities.
* Collaborate with global teams to build a shared platform that aggregates customer usage data into a centralized data lake.
* Contribute to architecture decisions, engineering standards, and platform growth.

**Required Qualifications**

* **Strong Python software engineering background** (Python Developer first, Data Engineer second)

**Experience with:**

* Python
* Django and/or Flask
* PySpark
* Databricks
* REST APIs
* Object-Oriented Design
* Git
* Data Engineering experience including:
* Data pipelines and data lakes
* Spark optimization and performance tuning
* Data modeling and distributed systems

**Preferred:**

* AWS (S3, Glue, Lambda)
* CI/CD and DevOps practices

What We're Looking For

Someone who writes clean, maintainable code, enjoys solving complex engineering problems, and wants a voice in architecture and technical direction. If your background is primarily notebook development without significant software engineering experience, this likely won't be the right fit.