Job description

Prescient Edge is seeking a Full-Stack Data Engineer to support a Federal Government client. Please note that the availability of this position is contingent upon contract award. Benefits: At Prescient Edge , we believe that acting with integrity and serving our employees is the key to everyone's success. To that end, we provide employees with a best-in-class benefits package that includes: • A competitive salary with performance bonus opportunities.  • Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage. • A substantial retirement plan with no vesting schedule. • Career development opportunities, including on-the-job training, tuition reimbursement, and networking. • A positive work environment where employees are respected, supported, and engaged. Description: • Proposed personnel possess the knowledge and capability to develop, maintain, and optimize an outward-facing data catalog that integrates geospatial and research data layers. • Optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. • Must be proficient in full-stack development, database architecture, and API integration to enable seamless search, filtering, and rendering of structured research products. • Must be proficient in Data Lakes splat forms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud based data engineering. • Expertise in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability is required. • Shall establish and maintain metadata governance frameworks, ensuring compliance with DoD data management policies and interoperability with a Data Catalog. • Shall develop automated metadata tagging processes to improve data discoverability, classification, and lineage tracking within the Common Intelligence Picture (CIP) platform. • Shall implement and manage data governance workflows, ensuring integration with Open Lineage, Unity Catalog, and GIS metadata standards. • Shall submit the Metadata & Data Governance Compliance Report, detailing lineage tracking, classification policies, and security enhancements. • Shall develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform. • Shall optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets. • Shall integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks. • Shall submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations. Requirements Experience: • Must have demonstrated experience in developing interactive web-based data portals, implementing API driven data exchange, and integrating geospatial data layers into web applications. • Must have experience working with Databricks, ESRI ArcGIS Feature Services, Open Lineage, and metadata management solutions is required. • Must have demonstrated experience in: Developing and deploying full-stack applications that enable data visualization, dashboarding, and analytics within ESRI based GIS platforms, Unity Catalog, and cloud-based databases. • Implementing RESTful and GraphQL APIs for seamless data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources. • Managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products. • Optimizing database queries and indexing strategies for large-scale geospatial and structured datasets. • Desirable but not required certifications include Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics – Specialty, or ESRI Web GIS Developer Certification. Education: • Bachelor’s degree in computer science, Data Engineering, Geospatial Information Systems (GIS), or a related field, or five (5) years of equivalent experience in data engineering, full-stack development, and metadata-driven data cataloging. Security clearance: • TS/SCI Location: • Doral, Florida. (USSOUTHCOM Headquarters)

Requirements

Must-haves

Prescient Edge is seeking a Full-Stack Data Engineer to support a Federal Government client.
Please note that the availability of this position is contingent upon contract award.
Proposed personnel possess the knowledge and capability to develop, maintain, and optimize an outward-facing data catalog that integrates geospatial and research data layers.
Optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.
Must be proficient in full-stack development, database architecture, and API integration to enable seamless search, filtering, and rendering of structured research products.
Must be proficient in Data Lakes splat forms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud based data engineering.
Expertise in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability is required.
Shall establish and maintain metadata governance frameworks, ensuring compliance with DoD data management policies and interoperability with a Data Catalog.
Shall develop automated metadata tagging processes to improve data discoverability, classification, and lineage tracking within the Common Intelligence Picture (CIP) platform.
Shall implement and manage data governance workflows, ensuring integration with Open Lineage, Unity Catalog, and GIS metadata standards.
Shall submit the Metadata & Data Governance Compliance Report, detailing lineage tracking, classification policies, and security enhancements.
Shall develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform.
Shall optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets.
Shall integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks.
Shall submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations.
Must have demonstrated experience in developing interactive web-based data portals, implementing API driven data exchange, and integrating geospatial data layers into web applications.
Must have experience working with Databricks, ESRI ArcGIS Feature Services, Open Lineage, and metadata management solutions is required.
Implementing RESTful and GraphQL APIs for seamless data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
Managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
Optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.
Desirable but not required certifications include Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics – Specialty, or ESRI Web GIS Developer Certification.
Doral, Florida. (USSOUTHCOM Headquarters)

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

apikubernetesgraphqlci/cdazureaws

Platform: hrsmart
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision