Access to Earth System Modelling Data within WarmWorld Easier

We are delighted, that you are interested in accessing the Earth System Modelling data through the services developed within the module Easier of the WarmWorld project. The access is currently restricted to project partners within the WarmWorld project. A detailed documentation of the catalog and data access services is available in the user guide.

We offer a user guide to the metadata catalog and the data access services.

Metadata Catalog

The available data are listed in SpatioTemporal Asset Catalogs (STAC, https://stacspec.org/). We offer a single catalog within WarmWorld:

• Federated Catalog - This catalog contains data from various JSC and DKRZ.

STAC Browser

A STAC Browser is a graphical interface to explore the STAC Catalogs. It allows you to search for datasets, view metadata, and access data files. The single catalog can be accessed through the STAC Browser.

• Federated Catalog

Data Access

To access the data, you need to register and agree to the terms of use. The registration is currently only possible for project partners within the WarmWorld project. Once you have registered, you will receive an email with the required information to access the data.

To register, please fill out the registration form.

Data Access Service

We host a number of data access services at JSC. Those allow to download data in grib format or stream them in zarr format (this is highly experimental). The different endpoints are for example documented under https://esm-data.fz-juelich.de/api/v1/docs. Quick start guides are included in the user guide.

Data Access Endpoints

The general endpoints for the data access are quite free and allow the creation of own requests. To simplify the data access for new users. the STAC catalog provides ready to use requests to access particular datasets.

OpenID Connect Tokens

General Considerations

OpenID Connect is a standard for authentication and authorization. It allows users to log in to applications using their existing accounts from identity providers like Helmholtz ID. This simplifies the login process and enhances security. One security aspect is, that tokens do expire after a certain time.

oidc-agent

The services require openID connect tokens. You can create the required tokens with the oidc-agent, which has build in support for the Helmholtz ID. This can be a good solution especially for scripts or automated workflows.

Mytoken

MYtoken is a service developed at KIT for the creation and handling of OpenID Connect tokens through a web service (curl, webpage). The underlying concept of mytokens allows a further control on how and where tokens can be used. The service can be used with a command line clint, HTTP requests (e.g. with curl) or through a web interface. This allows usage without the need to install additional software, which can be an advantage for users with limited access to their local system (e.g. on workstations at DKRZ). The service is available at https://mytoken.data.kit.edu/. The documentation can be found at https://docs.mytok.eu/.