Senior Data Engineer

Job Description

Absolute Business Solutions Corp ABSC is not just another tech company Were a community of innovators engineers analysts and business professionals working together with our customers to tackle the most complex challenges For more than 20 years weve supported critical Department of Defense DoD Intelligence Community IC Federal Civilian missions and global multi national corporations We specialize in supporting our clients in the Intelligence Technology Defense AIML and Data Science fields As we continue to grow at a rapid pace we need some amazing new professionals to join our team ABSC is seeking a mission driven Senior Data Engineer to join our high impact team supporting the National Digital Exploitation and Open Source Center NDOC DOMEX Technology Platform DTP In this role you will help improve data intelligence pipelines serving both Open Source Intelligence OSINT operations and document media exploitation for the Department of War DoW and the broader Intelligence Community IC Youll play a critical role in developing a future state AI managed DOMEX Data Discovery Platform D3P and DIA NDOCs mission While the work is primarily conducted on site at our client location in Bethesda MD we offer a flexible schedule and occasionally some tasks may be performed remotely Percentage of remote work will vary based on client requirementsdeliverables Security clearance required for this role An Active TSSCI with abilitywillingness to obtain a CI polygraph is required Responsibilities As a Senior Data Engineer you will design develop and optimize scalable data management solutions supporting advanced analytics and AIML workloads Working closely with data scientists software engineers and infrastructure teams you will build and maintain Elasticsearch and graph based data platforms that enable efficient storage discovery and analysis of complex hierarchical dataAbility to become a POSTMAN power user to support the discovery of critical intelligence insights Design and optimize Elasticsearch indices to efficiently manage large scale hierarchical classification structures ensuring high performance search aggregation and update operationsDesign implement and maintain a graph data store supporting hierarchical graph structures optimized for large dense batch updates and high throughput analyticsDevelop scalable ingestion pipelines that support scalable graph analyticsDesign data schemas indexing strategies and partitioning approaches to maximize query performance scalability and storage efficiencyCollaborate with infrastructure and platform engineering teams to deploy operate and optimize Elasticsearch and graph database services in a Kubernetes environment using cloud native technologiesPartner with Data Scientists and AIML engineers to ingest curate manage analyze and securely expunge datasets throughout the data lifecycleDevelop automated data loading transformation validation and quality assurance pipelines supporting production analytics workflowsOptimize graph and search infrastructure for high availability resilience and performance under large scale analytical workloadsCollaborate with software engineers and system architects to integrate graph and search services into microservice based applicationsParticipate in SAFe Agile development activities including sprint planning design reviews architecture discussions and technical demonstrationsFoster a culture of innovation collaboration and professional development within the teamEnsure sound engineering practices compliance with policies and delivery of high quality softwareCoordinate with test teams to develop and monitor automated system integration testsEngage with cross functional teams to identify and develop high value integrations with other systemsapplicationsProvide specific input to the software components of system design to include hardwaresoftware trade offs software reuse use of COTSGOTS in place of new development and requirements analysis and synthesis from system level to individual software componentsRequirements To be successful in this role you need required Bachelors degree in Computer Science Data Engineering or related field and 1215 years of relevant experience or Masters with 1013 years of experienceMust possess an Active Top SecretSCI clearance and ability to obtain and maintain a PolygraphElasticsearchOpenSearch architecture index design mappings analyzers and query optimizationGraph databases such as JanusGraph Neo4j TigerGraph Amazon Neptune or MemgraphData modeling for hierarchical and highly connected datasetsLarge scale ETLELT pipeline developmentKubernetes deployment and operations for stateful data servicesDistributed storage systems and high volume data ingestionPython or Java for data engineering and automationDesired Skills You will wow us even more if you have some of these Experience supporting AIML and data science workflows Apache Kafka or similar streaming technologiesExperience with Linux containerization CICD pipelines and Infrastructure as CodeGraph analytics frameworks and algorithms including graph traversal centrality community detection similarity analysis and link predictionExperience with Keycloak and security best practices authNZ secrets managementExperience building and maintaining microservices in KubernetesFamiliar with infrastructure as code CloudFormation Terraform PulumiSalary is commensurate with education and years experience Salary range for this requisition is 125k 255k annual Who we are ABSC is a technology and services company that combines the agility of a small business with proven processes refined over more than two decades in business We specialize in supporting public sector clients in the Intelligence Defense Health and Safety areas Our team stands ready to deliver the next generation of programs personnel and solutions to help advance our federal government customers driving innovation agility and security across all mission areas Some of our benefits include Generous PTO plus 11 Federal HolidaysRetirement Planning 401k Fully Vested with MatchAnnual Health and Wellness Allowance buy an Apple Watch a treadmill or hit the gym on usCareer Development Annual Funds to spend on Education and TrainingVolunteer Time Off Annually all employees can spend 8 hours directly supporting a charity of choiceCharitable Match ABSC matches an employees donation to a qualifying charityReferral Program We pay for internal and external referralsLOV Awards Earn bonus awards throughout the year from our Living Our Values awards programApply to join our team today We are always looking to grow our team if you know someone who is seeking a new career opportunity please share this job opening with them ABSC offers generous external referral bonuses You dont need to be an employee to benefit from our Referral Program ABSC is a proud V3 Virginia Values Vets member which recognizes our commitment to hiring Veterans If you are a veteran please be sure to include that in your application Equal Opportunity Employer including veterans and individuals with disabilities