Open role
ESRI Data Engineer
- Aggregated by CV-Library
- Portsmouth, Hampshire
- Contract
- Full Time
Job Description
We are seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines that underpin operational and analytical services supporting Royal Navy Maritime Domain Awareness outputs.
This is a hands-on engineering role, focused on building and operating containerised data and integration services within enterprise on-premise environments that collect, process, enrich and disseminate data across enterprise and geospatial platforms. You will work across the technology stack and will be expected to understand and troubleshoot the infrastructure, operating systems, networking, storage and platform services upon which data services depend.
You will work across the full data lifecycle, from ingestion through to delivery, ensuring data is accessible, trusted and usable. You will take new and existing sources of operational data and engineer reliable ways to acquire, process, store, enrich, and disseminate them. This may involve APIs, streaming data, enterprise messaging, spatial data, databases and geospatial platforms. The emphasis is on solving integration and data engineering problems rather than working with any single product or technology.
Experience with enterprise GIS technologies such as ESRI ArcGIS Enterprise would be advantageous but is not essential. We are primarily seeking experienced data engineers with strong engineering fundamentals who can apply those skills across a range of enterprise data technologies.
What You Will Do
Working within established engineering processes and standards, you will:
* Design, build and maintain data acquisition services to ingest information from APIs, message brokers, file systems, sockets, sensors and other enterprise data sources.
* Develop and support event-driven and streaming data services using enterprise messaging and integration platforms.
* Design and implement integrations between enterprise platforms, message brokers, APIs, databases, geospatial applications and external data providers.
* Design and implement mechanisms for secure dissemination of data through APIs, message brokers, file-based exchange and other operational interfaces.
* Contribute to the solution design activities, selecting appropriate storage, processing and dissemination approaches for new data sources and requirements.
* Ensure data quality, integrity and availability across platforms.
* Monitor and optimise data pipelines for performance and reliability.
* Troubleshoot and resolve complex data and platform issues.
* Contribute to automation and CI/CD of data services.
* Collaborate with stakeholders to understand and deliver data requirements.
* Produce technical documentation, runbooks and operational artefacts.
What We Are Looking For
Essential
* Experience engineering and supporting data services within on-premise or self-managed hosting environments, with an understanding of the underlying infrastructure and platform dependencies.
* Experience building and maintaining data pipelines.
* Experience diagnosing and resolving issues in operational production services.
* Strong Python and SQL skills.
* Experience working with structured data and databases.
* Understanding of event-driven architectures and messaging platforms.
* Understanding of data modelling and transformation techniques.
* Experience with Linux environments.
* Strong problem-solving and analytical skills.
* Ability to work independently within defined standards.
* Ability to learn and apply unfamiliar technologies to solve engineering problems.
Desirable
* Experience with container orchestration tools or enterprise data platform technologies.
* Experience with streaming and messaging platforms such as Apache Kafka.
* Experience with CI/CD pipelines, infrastructure automation and DevOps working practices.
* Experience developing or supporting containerised applications within Kubernetes environments.
* Experience with enterprise GIS platforms and geospatial data technologies (e.g. ESRI ArcGIS Enterprise, GeoEvent, Velocity, spatial databases).
* Experience integrating enterprise platforms using REST APIs and automation.
* Experience working with object storage platforms and S3-compatible interfaces.
* Experience in secure or regulated environments.
* Experience implementing data exchange solutions across security domains or controlled information environments.
* Familiarity with service management tools (e.g. Jira, Confluence).
Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy
This is a hands-on engineering role, focused on building and operating containerised data and integration services within enterprise on-premise environments that collect, process, enrich and disseminate data across enterprise and geospatial platforms. You will work across the technology stack and will be expected to understand and troubleshoot the infrastructure, operating systems, networking, storage and platform services upon which data services depend.
You will work across the full data lifecycle, from ingestion through to delivery, ensuring data is accessible, trusted and usable. You will take new and existing sources of operational data and engineer reliable ways to acquire, process, store, enrich, and disseminate them. This may involve APIs, streaming data, enterprise messaging, spatial data, databases and geospatial platforms. The emphasis is on solving integration and data engineering problems rather than working with any single product or technology.
Experience with enterprise GIS technologies such as ESRI ArcGIS Enterprise would be advantageous but is not essential. We are primarily seeking experienced data engineers with strong engineering fundamentals who can apply those skills across a range of enterprise data technologies.
What You Will Do
Working within established engineering processes and standards, you will:
* Design, build and maintain data acquisition services to ingest information from APIs, message brokers, file systems, sockets, sensors and other enterprise data sources.
* Develop and support event-driven and streaming data services using enterprise messaging and integration platforms.
* Design and implement integrations between enterprise platforms, message brokers, APIs, databases, geospatial applications and external data providers.
* Design and implement mechanisms for secure dissemination of data through APIs, message brokers, file-based exchange and other operational interfaces.
* Contribute to the solution design activities, selecting appropriate storage, processing and dissemination approaches for new data sources and requirements.
* Ensure data quality, integrity and availability across platforms.
* Monitor and optimise data pipelines for performance and reliability.
* Troubleshoot and resolve complex data and platform issues.
* Contribute to automation and CI/CD of data services.
* Collaborate with stakeholders to understand and deliver data requirements.
* Produce technical documentation, runbooks and operational artefacts.
What We Are Looking For
Essential
* Experience engineering and supporting data services within on-premise or self-managed hosting environments, with an understanding of the underlying infrastructure and platform dependencies.
* Experience building and maintaining data pipelines.
* Experience diagnosing and resolving issues in operational production services.
* Strong Python and SQL skills.
* Experience working with structured data and databases.
* Understanding of event-driven architectures and messaging platforms.
* Understanding of data modelling and transformation techniques.
* Experience with Linux environments.
* Strong problem-solving and analytical skills.
* Ability to work independently within defined standards.
* Ability to learn and apply unfamiliar technologies to solve engineering problems.
Desirable
* Experience with container orchestration tools or enterprise data platform technologies.
* Experience with streaming and messaging platforms such as Apache Kafka.
* Experience with CI/CD pipelines, infrastructure automation and DevOps working practices.
* Experience developing or supporting containerised applications within Kubernetes environments.
* Experience with enterprise GIS platforms and geospatial data technologies (e.g. ESRI ArcGIS Enterprise, GeoEvent, Velocity, spatial databases).
* Experience integrating enterprise platforms using REST APIs and automation.
* Experience working with object storage platforms and S3-compatible interfaces.
* Experience in secure or regulated environments.
* Experience implementing data exchange solutions across security domains or controlled information environments.
* Familiarity with service management tools (e.g. Jira, Confluence).
Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy