Zarr at Scale

Appearance

Zarr at ScaleWhat's new in Zarr

Working with multi-terabyte Earth-science datasets is now routine.

Sharding
Virtualization
Variable chunk grids
In-browser rendering

Sharding

Many small chunks, few storage objects. Random access of small chunks with the storage footprint of large ones.

Virtualization

Read NetCDF4, HDF5, GRIB, and GeoTIFF archives as one Zarr dataset, no conversion or copies.

Variable chunk grids

One Zarr array, many chunk sizes. Just landed in zarr-python.

In-browser rendering

Stream Zarr chunks straight to the GPU with Zarrita.js and deck.gl-raster. No server, no pre-rendered tiles.

EGU 2026 poster ​

This site is the companion to the EGU 2026 poster Zarr at scale: virtualization, sharding, and performance optimizations for Earth science data (EGU26-15196), presented in session ESSI2.2 on Monday 4 May 2026.

View the poster (HTML) · Download as PDF · Abstract · Source on GitHub

See also ​

Citation ​

Jones, M., Hamman, J., Bennett, D., Barron, K., and Magin, J.: Zarr at scale: virtualization, sharding, and performance optimizations for Earth science data, EGU General Assembly 2026, Vienna, Austria, 3–8 May 2026, EGU26-15196, https://doi.org/10.5194/egusphere-egu26-15196, 2026.

EGU 2026 · ESSI2.2 · EGU26-15196

CC BY 4.0