E3SM v2.1 BGC Data Published and upcoming changes in native E3SM data availability
The biogeochemistry (BGC) Human-Earth System (HES) Feedbacks group’s v2.1 data is now available on E3SM Data Docs.
In addition to the announcement of the new E3SMv2.1 data release, E3SM would also like to address and explain the changes to E3SM data availability and data publication policies moving forward, which are dictated by the combined effects of changes to the Earth System Grid Federation (ESGF) infrastructure and the decommission of the aging big data storage at LLNL.
Background
Over the past decade, E3SM has made both its native simulation data and CMIP format data available to the world through publication to the ESGF, enabling users to search for and retrieve datasets through the ESGF search index nodes (e.g. Metagrid). The native datasets are very large
Changing Data Availability and New Policies for Data Publication
The ESGF is currently in transition from v1 to v1.5 of their data support and indexing systems, and with the transition of the big storage from aging system at LLNL to new storage system at ANL, a decision has been made to not re-publish the native data to ESGF, which would have required to move all the data to ANL. Instead only the CMIP derived datasets will be accessible through ESGF and only CMIP derived data (timeseries and climatologies) will be published to ESGF from now on. The native datasets have been and will be archived to the NERSC HPSS storage facility, and will remain accessible through the “E3SM Data Docs” website described herein.
New BGC HES v2.1 Data
The E3SM is announcing the first availability of v2.1 BGC HES campaign data (BGCv2LNDATM) in native format. It is available from HPSS at NERSC and the links are provided on Data Docs at (TODO: add link). The BGCv2LNDATM configuration represents emissions-driven land–atmosphere biogeochemistry coupling in E3SMv2.1 (BGCv2LNDATM), which allows for enabling prognostic CO₂ that is crucial for capturing the dynamic carbon-earth system interactions.
Data Documentation Site
E3SM Data Docs is a dedicated website documenting E3SM data. Here, you can find comprehensive directions for accessing data along with essential metadata. Previously, only version 2 (v2) data was documented here, but there are plans to back-fill information on version 1 (v1) data in the future. In the meantime, v1 data can be accessed on the E3SM website. Information on v3 simulation campaigns will be added later this year.
Future CMIP6 E3SM Data Publication
Note, however, with the April 5, 2025 closure of CMIP6, future E3SM CMIP6 datasets will be made available through ESGF/Metagrid under a new E3SM Project, “CMIP6-E3SM-Ext” (E3SM Extension), This data (e.g., v3-LR) will be made available through a super-index cross all ESGF US nodes.
Data Policies
Please familiarize yourself with overall E3SM Policies about the use of the new data. Please read
Publications using E3SM model, or data, or other software are asked to acknowledge E3SM and DOE, BER. See
Related stories
- From November’s edition: Latest data accessible (internal link)
This article is a part of the E3SM “Floating Points” Newsletter, to read the full Newsletter check:
