The original system set up to distribute GHRSST data products has grown and become more complex with the addition of more Data Assembly Centres (DACs) and data producers. The GHRSST Data and Services Technical Advisory Group (DAS-TAG) recognised that a well-defined system with greater decentralisation of data ingestion and distribution would better prepare GHRSST for future growth and facilitate the participation of new data producers.

OBJECTIVES

The R/G TS TT was tasked with the definition, design and oversight of the implementation of the new Regional and Global Task Sharing System.

The new R/G TS will provide central end-point access (dataset catalogue and federated OpenSearch granule-level search service) to otherwise distributed data archiving, distribution and search services (implemented by DACs).

ACTIVITIES

The R/G TS TT has produced a report “GHRSST R/G TS System Architecture (GSA)” which describes the agreed new framework for the GHRSST R/G TS. The report describes the data management and distribution services and specifies the services that are required to implement them. The new R/G TS was reviewed and approved at the GHRSST XXI meeting in 2020.

Information on DAC service provision was gathered in a survey conducted for GHRSST XXI (2020).

Task 1: Implementation and population of a central catalogue of GHRSST datasets

This task will rely on existing metadata conventions and software solutions and is supported through EUMETSAT/Copernicus funding. It is expected to be completed by GHRSST XXIII with most of the development work done through 2021; feeding of the catalogue itself being completed between GHRSST XXII and GHRSST XXIII.

Task 2: Implementation and operation of HTTP(S) (mandatory) & FTP (strongly recommended) service at each DAC

The survey of DACs showed each DAC was providing HTTP(S) or FTP. Only two of seven DACs were not providing HTTP(S), and only one could not commit to HTTP(S) within the next two years. We consider this task already implemented with increasing homogenization (HTTP(S) becoming the main standard) over the next two years.

Task 3: Implementation and operation of OpenSearch-compliant granule search service at each DAC

Five of the surveyed DACs do not currently provide an OpenSearch service, of the five only two could not commit to doing so in the next two years. However, this type of service is becoming increasingly available from various data providers and cloud-based processing platforms; the R/G TS team is investigating mitigation solutions. It is expected that most DACs will have implemented this service by GHRSST XXIII (in 2022). Mitigation solutions shall make it possible to have all GHRSST products searchable by GHRSST XXIV (in 2023).

Task 4: Implementation of central GHRSST OpenSearch end-point for federated queries

The implementation of this end-point service will be supported through EUMETSAT/Copernicus funding and is expected to be completed by GHRSST XXIII (in 2022).

The service will connect the DAC OpenSearch services available at that time.

LAST REPORT TO THE SCIENCE TEAM

TASK TEAM MEMBERS

Chair and co-chair: Jean-François Piollé (Ifremer), Ed Armstrong (JPL/PO.DAAC)

Members: Sheekela Baker, Helen Beggs, Kenneth Casey, Mitsuhiko Fuda, Pallavi Govekar, Jacob Høyer, Sasha Ignatov, Bruce McKenzie, Kachi Misako, Hideyuki Muramatsu, Korak Saha, Igor Tomazic, Cristina Tronconi, Yongsheng Zhang, Pia Nielsen-Englyst, Oli Jonasson, Victor Pryamitsyn. Main contact points per GDP or DAC.

TOOLS

INTERESTED IN CONTRIBUTING?

Please contact the chair/co-chair or the task leaders directly:

  • Jean-François Piollé, Jean.Francois.Piolle@ifremer.fr
  • Ed Armstrong, edward.m.armstrong@jpl.nasa.gov