Data Catalog

The following describes the architecture of the eFlows4HPC Data Catalog. The service will provide information about data sets used in the project. The catalog will store information about locations, schemas, and additional metadata.

Main features:

  • keep track of data sources used in the project (by workflows)

  • enable registration of new data sources

  • provide user-view as well as simple API to access the information

The Data Catalog is mainly developed at FZJ. The source code for stable versions can be found in this Repository. A description of the architecture can be found here.

The running istance with content is hosted on the HDF Cloud and can be accessed at this Address.

The Data Catalog offers an API to access and manipulate its content.