Data Lake Engineer

Job Description

Position Summary
- ---------------

Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.

Essential Duties and Responsibilities
- ------------------------------------

* Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
* Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
* Build scalable, secure web applications with metadata-driven search and retrieval features.
* Integrate APIs for seamless data interoperability.
* Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
* Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
* Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
* Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.

Required Qualifications
- ----------------------

* Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
* Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
* Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
* Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
* Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Preferred Qualifications
- -----------------------

* AWS Certified Data Analytics - Specialty.
* Microsoft Certified: Azure Data Engineer Associate.
* ESRI ArcGIS Developer Certification.

Required Education and Experience Equivalency
- --------------------------------------------

* Bachelor's degree in Computer Science, Data Engineering, or a related field.
* OR 5 years of equivalent experience in full-stack development and data engineering.

Required Certifications
- ----------------------

* None specified.

Required Security Clearance
- --------------------------

* Active Top Secret/SCI