Presenters-0611

CSDMS 2023: Patterns and Processes Across Scales

Emerging open-source Python-based infrastructure for scalable, data-proximate analysis and visualization of model output

Rich Signell
USGS, United States
rsignell@usgs.gov

Abstract
This clinic will introduce and demonstrate use of a powerful, flexible approach being used by the Pangeo community for working with large model output which works effectively on a range of computing systems including local machines, HPC facilities and the Cloud. Xarray is used for working with CF-compliant model output, Dask for parallelization, and Holoviz for interactive visualization in the browser. Rechunking data to improve performance for a variety of analysis use cases will also be covered.

Please acknowledge the original contributors when you are using this material. If there are any copyright issues, please let us know (CSDMSweb@colorado.edu) and we will respond as soon as possible.

Of interest for:

Marine Working Group

Terrestrial Working Group

Coastal Working Group

Education and Knowledge Transfer (EKT) Working Group

Cyberinformatics and Numerics Working Group

Hydrology Focus Research Group

Chesapeake Focus Research Group

Critical Zone Focus Research Group

Human Dimensions Focus Research Group

Geodynamics Focus Research Group

Ecosystem Dynamics Focus Research Group

Coastal Vulnerability Initiative

Continental Margin Initiative

Artificial Intelligence & Machine Learning Initiative

Modeling Platform Interoperability Initiative

River Network Modeling Initiative