Presenters-0611: Difference between revisions

From CSDMS
(Created page with "{{Presenters temp |CSDMS meeting event title=CSDMS 2023: Patterns and Processes Across Scales |CSDMS meeting event year=2023 |CSDMS meeting presentation type=Clinic |CSDMS meeting first name=Rich |CSDMS meeting last name=Signell |CSDMS meeting institute=USGS |Country member=United States |CSDMS meeting state=Massachusetts |CSDMS meeting email address=rsignell@usgs.gov |CSDMS meeting title presentation=Emerging open-source Python-based infrastructure for scalable, data-pr...")
 
m (Text replacement - "Carbonates and Biogenics Focus Research Group, " to "")
 
Line 17: Line 17:
}}
}}
{{Presenters additional material
{{Presenters additional material
|Working group member=Marine Working Group, Terrestrial Working Group, Coastal Working Group, Education and Knowledge Transfer (EKT) Working Group, Cyberinformatics and Numerics Working Group, Hydrology Focus Research Group, Carbonates and Biogenics Focus Research Group, Chesapeake Focus Research Group, Critical Zone Focus Research Group, Human Dimensions Focus Research Group, Geodynamics Focus Research Group, Ecosystem Dynamics Focus Research Group, Coastal Vulnerability Initiative, Continental Margin Initiative, Artificial Intelligence & Machine Learning Initiative, Modeling Platform Interoperability Initiative, River Network Modeling Initiative
|Working group member=Marine Working Group, Terrestrial Working Group, Coastal Working Group, Education and Knowledge Transfer (EKT) Working Group, Cyberinformatics and Numerics Working Group, Hydrology Focus Research Group, Chesapeake Focus Research Group, Critical Zone Focus Research Group, Human Dimensions Focus Research Group, Geodynamics Focus Research Group, Ecosystem Dynamics Focus Research Group, Coastal Vulnerability Initiative, Continental Margin Initiative, Artificial Intelligence & Machine Learning Initiative, Modeling Platform Interoperability Initiative, River Network Modeling Initiative
}}
}}

Latest revision as of 15:07, 20 June 2023

CSDMS 2023: Patterns and Processes Across Scales


Emerging open-source Python-based infrastructure for scalable, data-proximate analysis and visualization of model output



Rich Signell

USGS, United States
rsignell@usgs.gov


Abstract
This clinic will introduce and demonstrate use of a powerful, flexible approach being used by the Pangeo community for working with large model output which works effectively on a range of computing systems including local machines, HPC facilities and the Cloud. Xarray is used for working with CF-compliant model output, Dask for parallelization, and Holoviz for interactive visualization in the browser. Rechunking data to improve performance for a variety of analysis use cases will also be covered.

Please acknowledge the original contributors when you are using this material. If there are any copyright issues, please let us know (CSDMSweb@colorado.edu) and we will respond as soon as possible.

Of interest for:
  • Marine Working Group
  • Terrestrial Working Group
  • Coastal Working Group
  • Education and Knowledge Transfer (EKT) Working Group
  • Cyberinformatics and Numerics Working Group
  • Hydrology Focus Research Group
  • Chesapeake Focus Research Group
  • Critical Zone Focus Research Group
  • Human Dimensions Focus Research Group
  • Geodynamics Focus Research Group
  • Ecosystem Dynamics Focus Research Group
  • Coastal Vulnerability Initiative
  • Continental Margin Initiative
  • Artificial Intelligence & Machine Learning Initiative
  • Modeling Platform Interoperability Initiative
  • River Network Modeling Initiative