Model:ILAMB: Difference between revisions

From CSDMS
Created page with "{{Model identity |Model type=Tool }} {{Start models incorporated}} {{End a table}} {{Model identity2 |Categories=Terrestrial,Coastal,Hydrology,Climate,Cryosphere |Spatial dime..."
 
m Text replacement - "{{End headertab}}" to "{{End headertab}} {{{{PAGENAME}}_autokeywords}}"
 
(14 intermediate revisions by 3 users not shown)
Line 5: Line 5:
{{End a table}}
{{End a table}}
{{Model identity2
{{Model identity2
|Categories=Terrestrial,Coastal,Hydrology,Climate,Cryosphere
|ModelDomain=Terrestrial, Hydrology, Marine, Climate, Ecosystems, Cryosphere
|Spatial dimensions=1D, 2D
|Spatial dimensions=1D, 2D, 3D
|Spatialscale=Global, Continental, Regional-Scale
|Spatialscale=Continental, Global, Regional-Scale
|One-line model description=A model benchmarking system.
|One-line model description=The International Land Model Benchmarking (ILAMB) toolkit
|Extended model description=The International Land Model Benchmarking (ILAMB) project is a model-data intercomparison and integration project designed to improve the performance of land models and, in parallel, improve the design of new measurement campaigns to reduce uncertainties associated with key land surface processes. Building upon past model evaluation studies, the goals of ILAMB are to:
|Extended model description=The International Land Model Benchmarking (ILAMB) project is a model-data intercomparison and integration project designed to improve the performance of land models and, in parallel, improve the design of new measurement campaigns to reduce uncertainties associated with key land surface processes. Building upon past model evaluation studies, the goals of ILAMB are to:


Line 14: Line 14:
* strengthen linkages between experimental, remote sensing, and climate modeling communities in the design of new model tests and new measurement programs, and
* strengthen linkages between experimental, remote sensing, and climate modeling communities in the design of new model tests and new measurement programs, and
* support the design and development of a new, open source, benchmarking software system for use by the international community.
* support the design and development of a new, open source, benchmarking software system for use by the international community.
It is the last of these goals to which this software is concerned. We have developed a Python-based generic benchmarking system, initially focused on assessing land model performance.
}}
}}
{{Start model keyword table}}
{{Start model keyword table}}
Line 34: Line 32:
}}
}}
{{Model keywords
{{Model keywords
|Model keywords=data
|Model keywords=CMIP6
}}
}}
{{End a table}}
{{End a table}}
Line 48: Line 46:
|Country=United States
|Country=United States
|State=Tennessee
|State=Tennessee
|Email address=collierno@ornl.gov
|Email address=nathaniel.collier@gmail.com
}}
}}
{{Model technical information
{{Model technical information
Line 54: Line 52:
|Programming language=Python
|Programming language=Python
|Code optimized=Multiple Processors
|Code optimized=Multiple Processors
|Multiple processors implemented=Distributed memory
|Start year development=2015
|Start year development=2015
|Does model development still take place?=Yes
|Does model development still take place?=Yes
|DevelopmentCode=Active
|DevelopmentCodeYearChecked=2020
|Model availability=As code
|Model availability=As code
|Source code availability=Through web repository
|Source code availability=Through web repository
|Source web address=https://bitbucket.org/ncollier/ilamb
|Source web address=https://github.com/rubisco-sfa/ILAMB
|Program license type=Other
|Program license type=Other
|Program license type other=UT Battelle Open Source Software License
|Program license type other=UT Battelle Open Source Software License
Line 72: Line 73:
|Visualization software needed?=No
|Visualization software needed?=No
}}
}}
{{Process description model}}
{{Process description model
{{Model testing}}
|Describe processes represented by the model=ILAMB takes a set of observational data encoded as CF-compliant netCDF files, extracts commensurate quantities from historical model results (ideally compliant with CMOR), and then subjects them to a gauntlet of statistical measures examining aspects of performance such as bias, RMSE, phase, interannual variability, and spatial distribution. This results in a hierarchical set of webpages which display and controls the flow of information.
}}
{{Model testing
|Describe available calibration data sets=ILAMB has integrated testing of overall scores on a coarsened subset of observational data which runs via Azure pipelines.
}}
{{Users groups model
{{Users groups model
|Do you have current or future plans for collaborating with other researchers?=ILAMB is under continuous development with collaboration from researchers worldwide.
|Do you have current or future plans for collaborating with other researchers?=ILAMB is under continuous development with collaboration from researchers worldwide.
Line 79: Line 84:
{{Documentation model
{{Documentation model
|Manual model available=No
|Manual model available=No
|Model website if any=http://climate.ornl.gov/~ncf/ILAMB/docs/index.html
|Model website if any=https://www.ilamb.org/doc/
}}
}}
{{Additional comments model
{{Additional comments model
|Comments=The ILAMB home page is https://ilamb.org.
|Comments=For details on the methodology and underlying benchmarking philosophy, see the following paper:
 
Nathan Collier, Forrest M. Hoffman, David M. Lawrence, Gretchen Keppel‐Aleks, Charles D. Koven, William J. Riley, Mingquan Mu, and James T. Randerson, "The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation", JAMES, 10 (11), 2018, https://doi.org/10.1029/2018MS001354
}}
}}
{{CSDMS staff part
{{CSDMS staff part
Line 98: Line 105:
{{End a table}}
{{End a table}}
{{End headertab}}
{{End headertab}}
{{{{PAGENAME}}_autokeywords}}
<!-- PLEASE USE THE "EDIT WITH FORM" BUTTON TO EDIT ABOVE CONTENTS; CONTINUE TO EDIT BELOW THIS LINE -->
<!-- PLEASE USE THE "EDIT WITH FORM" BUTTON TO EDIT ABOVE CONTENTS; CONTINUE TO EDIT BELOW THIS LINE -->
{{#ifexist:Template:{{#sub:{{PAGENAME}}|0|1}}{{#sub:{{lc:{{PAGENAME}}}}|1}} download stats | ==Download statistics==
{{#ifexist:Template:{{#sub:{{PAGENAME}}|0|1}}{{#sub:{{lc:{{PAGENAME}}}}|1}} download stats | ==Download statistics==
Line 107: Line 116:


== References  ==
== References  ==
{{Add_reference_upload_button}}
<br>{{AddReferenceUploadButtons}}<br><br>
{{Add_model_references}}
{{#ifexist:Template:{{PAGENAME}}-citation-indices|{{{{PAGENAME}}-citation-indices}}|}}<br>
{{Include_featured_references_models_cargo}}<br>


== Issues ==
== Issues ==

Latest revision as of 20:17, 16 September 2020



ILAMB


Metadata

Also known as
Model type Tool
Model part of larger framework
Note on status model
Date note status model
Incorporated models or components:
Spatial dimensions 1D, 2D, 3D
Spatial extent Continental, Global, Regional-Scale
Model domain Terrestrial, Hydrology, Marine, Climate, Ecosystems, Cryosphere
One-line model description The International Land Model Benchmarking (ILAMB) toolkit
Extended model description The International Land Model Benchmarking (ILAMB) project is a model-data intercomparison and integration project designed to improve the performance of land models and, in parallel, improve the design of new measurement campaigns to reduce uncertainties associated with key land surface processes. Building upon past model evaluation studies, the goals of ILAMB are to:
  • develop internationally accepted benchmarks for land model performance, promote the use of these benchmarks by the international community for model intercomparison,
  • strengthen linkages between experimental, remote sensing, and climate modeling communities in the design of new model tests and new measurement programs, and
  • support the design and development of a new, open source, benchmarking software system for use by the international community.
Keywords:

benchmark, uncertainty, land surface processes, land model, CMIP5, CMIP6,

Name Nathan Collier
Type of contact Model developer
Institute / Organization Oak Ridge National Laboratory
Postal address 1 P.O. Box 2008
Postal address 2 1 Bethel Valley
Town / City Road Oak Ridge
Postal code 37831
State Tennessee
Country United States
Email address nathaniel.collier@gmail.com
Phone
Fax


Supported platforms
Unix, Linux, Mac OS
Other platform
Programming language

Python

Other program language
Code optimized Multiple Processors
Multiple processors implemented Distributed memory
Nr of distributed processors
Nr of shared processors
Start year development 2015
Does model development still take place? Yes
If above answer is no, provide end year model development
Code development status Active
When did you indicate the 'code development status'? 2020
Model availability As code
Source code availability
(Or provide future intension) 		Through web repository
Source web address https://github.com/rubisco-sfa/ILAMB
Source csdms web address
Program license type Other
Program license type other UT Battelle Open Source Software License
Memory requirements
Typical run time Minutes to several hours


Describe input parameters A configuration file specifying models and variables to confront against benchmark data sets.
Input format ASCII
Other input format
Describe output parameters A web page displaying skill scores for the models and plots (PNG) of the spatial distribution of model outputs versus benchmark data.
Output format ASCII, Binary
Other output format
Pre-processing software needed? No
Describe pre-processing software
Post-processing software needed? No
Describe post-processing software
Visualization software needed? No
If above answer is yes
Other visualization software


Describe processes represented by the model ILAMB takes a set of observational data encoded as CF-compliant netCDF files, extracts commensurate quantities from historical model results (ideally compliant with CMOR), and then subjects them to a gauntlet of statistical measures examining aspects of performance such as bias, RMSE, phase, interannual variability, and spatial distribution. This results in a hierarchical set of webpages which display and controls the flow of information.
Describe key physical parameters and equations
Describe length scale and resolution constraints
Describe time scale and resolution constraints
Describe any numerical limitations and issues


Describe available calibration data sets ILAMB has integrated testing of overall scores on a coarsened subset of observational data which runs via Azure pipelines.
Upload calibration data sets if available:
Describe available test data sets
Upload test data sets if available:
Describe ideal data for testing


Do you have current or future plans for collaborating with other researchers? ILAMB is under continuous development with collaboration from researchers worldwide.
Is there a manual available? No
Upload manual if available:
Model website if any https://www.ilamb.org/doc/
Model forum / discussion board
Comments For details on the methodology and underlying benchmarking philosophy, see the following paper:

Nathan Collier, Forrest M. Hoffman, David M. Lawrence, Gretchen Keppel‐Aleks, Charles D. Koven, William J. Riley, Mingquan Mu, and James T. Randerson, "The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation", JAMES, 10 (11), 2018, https://doi.org/10.1029/2018MS001354


This part will be filled out by CSDMS staff

OpenMI compliant No but possible
BMI compliant Yes
WMT component Yes
PyMT component
Is this a data component
DOI model International land Model Benchmarking (ILAMB) Package
For model version 2.0
Year version submitted 2016
Link to file DOI:10.18139/ILAMB.v002.00/1251621
Can be coupled with:
Model info
Authors
Nathan Collier
Source code
DOI

  • Download ILAMB [DOI:10.18139/ILAMB.v002.00/1251621 version: 2.0]
    Doi: International land Model Benchmarking (ILAMB) Package
Model citations
Nr. of publications: 9
Total citations: 571
h-index: 6
m-quotient: 0.6
QR-code

Link to this page
Other models by author



Introduction

History

References



Nr. of publications: 9
Total citations: 571
h-index: 6
m-quotient: 0.6



Featured publication(s)YearModel describedType of ReferenceCitations
Collier, Nathan; Hoffman, Forrest M.; Lawrence, David M.; Keppel‐Aleks, Gretchen; Koven, Charles D.; Riley, William J.; Mu, Mingquan; Randerson, James T.; 2018. The International Land Model Benchmarking (ILAMB) System: Design, Theory, and Implementation. Journal of Advances in Modeling Earth Systems, 10, 2731–2754. 10.1029/2018MS001354
(View/edit entry)		2018 ILAMB
 Model overview 191
See more publications of ILAMB


Issues

Help

Input Files

Output Files

Retrieved from "https://csdms.colorado.edu/csdms_wiki/index.php?title=Model:ILAMB&oldid=299980"