A Statistical Analysis of Lossily Compressed CESM-LENS Data

The data storage burden resulting from CESM simulations continues to grow, and lossy data compression methods can alleviate this burden, provided that key climate variables are not altered to the point of affecting scientific conclusions. This dataset was generated to evaluate the effects of two leading lossy compression algorithms, sz and zfp, on daily output data from the CESM-LENS dataset. In particular, it contains daily data for variables TS (surface temperature) and PRECT (precipitation rate) from the historical forcing period (1920-2005) for CESM-LENS ensemble member 30. The provided data has been compressed and reconstructed via two popular compressors: sz 1.4.13 and zfp 0.5.3 with a number of different absolute error tolerances. Errors due to compression can be determined by comparing these reconstructed files to the original CESM-LENS timeseries data, and statistical methods can evaluate the errors at different spatiotemporal scales. While both compression algorithms show promising fidelity with the original output, detectable artifacts are introduced even at relatively tight error tolerances.

DOI

https://doi.org/10.5065/5sqy-zf23

Temporal Range

1920-01-01 to 2005-12-31

Spatial Resolution

1.0 degreesLatitude
1.0 degreesLongitude

Related Links

N/A

GCMD Science Keywords

• Data Management/Data Handling > Data Compression
• Models > Atmospheric General Circulation Models

File Media Types

• application/x-hdf
• text/plain

Support Contact

Allison Baker
UCAR/NCAR - Computational and Information Systems Laboratory
abaker@ucar.edu

Data Curator

GDEX Curator
UCAR/NCAR - GDEX
datahelp@ucar.edu

Legal Constraints

Creative Commons Attribution 4.0 International License.

Access Constraints

None

Full Metadata

DIF XML
ISO19139 XML
OAI DC
JSON-LD

Version History

1.0