CSDMS 2023: Patterns and Processes Across Scales
Emerging open-source Python-based infrastructure for scalable, data-proximate analysis and visualization of model output
Abstract
This clinic will introduce and demonstrate use of a powerful, flexible approach being used by the Pangeo community for working with large model output which works effectively on a range of computing systems including local machines, HPC facilities and the Cloud. Xarray is used for working with CF-compliant model output, Dask for parallelization, and Holoviz for interactive visualization in the browser. Rechunking data to improve performance for a variety of analysis use cases will also be covered.
Please acknowledge the original contributors when you are using this material. If there are any copyright issues, please let us know (CSDMSweb@colorado.edu) and we will respond as soon as possible.
Of interest for: Marine Working GroupTerrestrial Working GroupCoastal Working GroupEducation and Knowledge Transfer (EKT) Working GroupCyberinformatics and Numerics Working GroupHydrology Focus Research GroupCarbonates and Biogenics Focus Research Group"Carbonates and Biogenics Focus Research Group" is not in the list (Terrestrial Working Group, Coastal Working Group, Marine Working Group, Education and Knowledge Transfer (EKT) Working Group, Cyberinformatics and Numerics Working Group, Hydrology Focus Research Group, Chesapeake Focus Research Group, Critical Zone Focus Research Group, Human Dimensions Focus Research Group, Geodynamics Focus Research Group, ...) of allowed values for the "Working group member" property.Chesapeake Focus Research GroupCritical Zone Focus Research GroupHuman Dimensions Focus Research GroupGeodynamics Focus Research GroupEcosystem Dynamics Focus Research GroupCoastal Vulnerability InitiativeContinental Margin InitiativeArtificial Intelligence & Machine Learning InitiativeModeling Platform Interoperability InitiativeRiver Network Modeling Initiative