AEP Data Engineer

Job Description

Skills Required6 years(6 year) of professional software engineering mostly focused on the following: • Developing ETL pipelines involving big data. • Developing data processing\\analytics applications primarily using PySpark. • Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming. • Clear understanding and ability to implement distributed storage, processing and scalable applications. • Experience of working with SQL and NoSQL database. • Ability to write and analyze SQL, HQL and other query languages for NoSQL databases. • Proficiency is writing disitributed \& scalable data processing code using PySpark, Python and related libraries.ValidationStart Date ValidatedJob DescriptionWhat you'll do • Develop low level design as per approved Tech Specification or equivalent inputs provided. • Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs. • Build and delivery technology deliverables compliant with functional requirements. • Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc. • Process technology deliverables through full development lifecycle. • Maintain and support existing solutions and technology frameworks. • Attend regular scrum events of equivalent and provide update on the deliverables. • Work independently with none or minimum supervision.