CSDMS - User contributions [en]

Alldata:North America 3 arcsec drainage area

2014-06-12T19:44:07Z

Alan r:

{{Data description
|One-line data description=The drainage area of North America at 3 arc sec resolution, from 7°N, 55°W to 60°N, 142°W
|Extended data description=The drainage area in m2 (rather than number of cells) for the 63600 x 104400 cells between 7°N, 55°W and 60°N, 142°W at 3 arcsecond resolution.

The 3 arcsecond flow direction data from HydroSHEDS were used as input to a drainage area calculation method ([[Model:IDA|IDA]]). The drainage area data were created in 64-bit floating point ('double precision') format, but to reduce download size this was reduced to 32-bit floating point ('single precision') format for distribution. NetCDF4's level 1 deflation with shuffling was employed to further reduce file size.

The NetCDF file contains three variables: drainage_area, lon, and lat. The first of these contains the drainage area data, while the latter two contain the coordinates in degrees.

This product (North America 3 arcsecond drainage area) incorporates data from the HydroSHEDS database which is © World Wildlife Fund, Inc. (2006-2013) and has been used herein under license. WWF has not evaluated the data as altered and incorporated within (North America 3 arcsecond drainage area), and therefore gives no warranty regarding its accuracy, completeness, currency or suitability for any particular purpose. Portions of the HydroSHEDS database incorporate data which are the intellectual property rights of © USGS (2006-2008), NASA (2000-2005), ESRI (1992-1998), CIAT (2004-2006), UNEP-WCMC (1993), WWF (2004), Commonwealth of Australia (2007), and Her Royal Majesty and the British Crown and are used under license. The HydroSHEDS database and more information are available at http://www.hydrosheds.org.
|Upload image dataset=Na da 3arcsec.png
|Caption dataset image=log10(drainage area)
}}
{{Data format
|Data type=Hydrography
|Data origin=Modeled
|Data format=NetCDF
|Data resolution=3 arcsecond
}}
{{Dataset coverage
|Data spatial coverage=7°N, 55°W to 60°N, 142°W
|Data temporal coverage=Time snap shot
}}
{{Dataset availability
|Data download link=http://csdms.colorado.edu/pub/data/North_America_3_arcsec_drainage_area/na_da_3arcsec.nc
|Data source link=http://www.hydrosheds.org
}}
{{Data references
|Key references dataset=Richardson, A., C. N. Hill, and J. T. Perron (2014), IDA: An implicit, parallelizable method for calculating drainage area, Water Resour. Res., 50, 4110–4130, doi:10.1002/2013WR014326.
}}
{{Data references
|Key references dataset=Lehner, B., Verdin, K., Jarvis, A. (2008): New global hydrography derived from spaceborne elevation data. Eos, Transactions, AGU, 89(10): 93-94.
}}

Reference:Reference-000543

2014-06-12T19:42:24Z

Alan r:

{{CSDMS publications
|Publication-citation=Richardson, A., C. N. Hill, and J. T. Perron (2014), IDA: An implicit, parallelizable method for calculating drainage area, Water Resour. Res., 50, 4110–4130
|Publication-DOI=10.1002/2013WR014326
|Publication-what-kind-of=a module overview, describing a module
|Publication-HPCC-yesno=No
|Publication-nrof-models=a single module
}}
{{Publications about a single model
|Publication-multiple-models=IDA
}}

Reference:Reference-000543

2014-02-28T22:22:46Z

Alan r: Created page with "{{CSDMS publications |Publication-citation=Richardson, A., Hill, C. N., Perron T. J.: IDA: An implicit, parallelizable method for calculating drainage area. (Under review) |Pu..."

{{CSDMS publications
|Publication-citation=Richardson, A., Hill, C. N., Perron T. J.: IDA: An implicit, parallelizable method for calculating drainage area. (Under review)
|Publication-what-kind-of=a module overview, describing a module
|Publication-HPCC-yesno=No
|Publication-nrof-models=a single module
}}
{{Publications about a single model
|Publication-multiple-models=IDA
}}

Alldata:North America 3 arcsec drainage area

2014-02-28T22:21:07Z

Alan r:

{{Data description
|One-line data description=The drainage area of North America at 3 arc sec resolution, from 7°N, 55°W to 60°N, 142°W
|Extended data description=The drainage area in m2 (rather than number of cells) for the 63600 x 104400 cells between 7°N, 55°W and 60°N, 142°W at 3 arcsecond resolution.

The 3 arcsecond flow direction data from HydroSHEDS were used as input to a drainage area calculation method ([[Model:IDA|IDA]]). The drainage area data were created in 64-bit floating point ('double precision') format, but to reduce download size this was reduced to 32-bit floating point ('single precision') format for distribution. NetCDF4's level 1 deflation with shuffling was employed to further reduce file size.

The NetCDF file contains three variables: drainage_area, lon, and lat. The first of these contains the drainage area data, while the latter two contain the coordinates in degrees.

This product (North America 3 arcsecond drainage area) incorporates data from the HydroSHEDS database which is © World Wildlife Fund, Inc. (2006-2013) and has been used herein under license. WWF has not evaluated the data as altered and incorporated within (North America 3 arcsecond drainage area), and therefore gives no warranty regarding its accuracy, completeness, currency or suitability for any particular purpose. Portions of the HydroSHEDS database incorporate data which are the intellectual property rights of © USGS (2006-2008), NASA (2000-2005), ESRI (1992-1998), CIAT (2004-2006), UNEP-WCMC (1993), WWF (2004), Commonwealth of Australia (2007), and Her Royal Majesty and the British Crown and are used under license. The HydroSHEDS database and more information are available at http://www.hydrosheds.org.
|Upload image dataset=Na da 3arcsec.png
|Caption dataset image=log10(drainage area)
}}
{{Data format
|Data type=Hydrography
|Data origin=Modeled
|Data format=NetCDF
|Data resolution=3 arcsecond
}}
{{Dataset coverage
|Data spatial coverage=7°N, 55°W to 60°N, 142°W
|Data temporal coverage=Time snap shot
}}
{{Dataset availability
|Data download link=http://csdms.colorado.edu/pub/data/North_America_3_arcsec_drainage_area/na_da_3arcsec.nc
|Data source link=http://www.hydrosheds.org
}}
{{Data references
|Key references dataset=Lehner, B., Verdin, K., Jarvis, A. (2008): New global hydrography derived from spaceborne elevation data. Eos, Transactions, AGU, 89(10): 93-94.
}}
{{Data references
|Key references dataset=Richardson, A., Hill, C. N., Perron T. J.: IDA: An implicit, parallelizable method for calculating drainage area. (Under review)
}}

Alldata:North America 3 arcsec drainage area

2014-02-28T22:18:03Z

Alan r: Linked mention of IDA to csdms wiki page for IDA

{{Data description
|One-line data description=The drainage area of North America at 3 arc sec resolution, from 7°N, 55°W to 60°N, 142°W
|Extended data description=The drainage area in m2 (rather than number of cells) for the 63600 x 104400 cells between 7°N, 55°W and 60°N, 142°W at 3 arcsecond resolution.

The 3 arcsecond flow direction data from HydroSHEDS were used as input to a drainage area calculation method ([[Model:IDA|IDA]]). The drainage area data were created in 64-bit floating point ('double precision') format, but to reduce download size this was reduced to 32-bit floating point ('single precision') format for distribution. NetCDF4's level 1 deflation with shuffling was employed to further reduce file size.

The NetCDF file contains three variables: drainage_area, lon, and lat. The first of these contains the drainage area data, while the latter two contain the coordinates in degrees.

This product (North America 3 arcsecond drainage area) incorporates data from the HydroSHEDS database which is © World Wildlife Fund, Inc. (2006-2013) and has been used herein under license. WWF has not evaluated the data as altered and incorporated within (North America 3 arcsecond drainage area), and therefore gives no warranty regarding its accuracy, completeness, currency or suitability for any particular purpose. Portions of the HydroSHEDS database incorporate data which are the intellectual property rights of © USGS (2006-2008), NASA (2000-2005), ESRI (1992-1998), CIAT (2004-2006), UNEP-WCMC (1993), WWF (2004), Commonwealth of Australia (2007), and Her Royal Majesty and the British Crown and are used under license. The HydroSHEDS database and more information are available at http://www.hydrosheds.org.
|Upload image dataset=Na da 3arcsec.png
|Caption dataset image=log10(drainage area)
}}
{{Data format
|Data type=Hydrography
|Data origin=Modeled
|Data format=NetCDF
|Data resolution=3 arcsecond
}}
{{Dataset coverage
|Data spatial coverage=7°N, 55°W to 60°N, 142°W
|Data temporal coverage=Time snap shot
}}
{{Dataset availability
|Data download link=http://csdms.colorado.edu/pub/data/North_America_3_arcsec_drainage_area/na_da_3arcsec.nc
|Data source link=http://www.hydrosheds.org
}}
{{Data references
|Key references dataset=Lehner, B., Verdin, K., Jarvis, A. (2008): New global hydrography derived from spaceborne elevation data. Eos, Transactions, AGU, 89(10): 93-94.
}}

Alldata:North America 3 arcsec drainage area

2014-01-02T15:46:02Z

Alan r: Created page with "{{Data description |One-line data description=The drainage area of North America at 3 arc sec resolution, from 7°N, 55°W to 60°N, 142°W |Extended data description=The drai..."

{{Data description
|One-line data description=The drainage area of North America at 3 arc sec resolution, from 7°N, 55°W to 60°N, 142°W
|Extended data description=The drainage area in m^2 (rather than number of cells) for the 63600 x 104400 cells between 7°N, 55°W and 60°N, 142°W at 3 arcsecond resolution.

The 3 arcsecond flow direction data from HydroSHEDS were used as input to a drainage area calculation method (IDA). The drainage area data were created in 64-bit floating point ('double precision') format, but to reduce download size this was reduced to 32-bit floating point ('single precision') format for distribution. NetCDF4's level 1 deflation with shuffling was employed to further reduce file size.

The NetCDF file contains three variables: drainage_area, lon, and lat. The first of these contains the drainage area data, while the latter two contain the coordinates in degrees.

This product (North America 3 arcsecond drainage area) incorporates data from the HydroSHEDS database which is © World Wildlife Fund, Inc. (2006-2013) and has been used herein under license. WWF has not evaluated the data as altered and incorporated within (North America 3 arcsecond drainage area), and therefore gives no warranty regarding its accuracy, completeness, currency or suitability for any particular purpose. Portions of the HydroSHEDS database incorporate data which are the intellectual property rights of © USGS (2006-2008), NASA (2000-2005), ESRI (1992-1998), CIAT (2004-2006), UNEP-WCMC (1993), WWF (2004), Commonwealth of Australia (2007), and Her Royal Majesty and the British Crown and are used under license. The HydroSHEDS database and more information are available at http://www.hydrosheds.org.
|Upload image dataset=Na da 3arcsec.png
|Caption dataset image=log10(drainage area)
}}
{{Data format
|Data type=Hydrography
|Data origin=Modeled
|Data format=NetCDF
|Data resolution=3 arcsecond
}}
{{Dataset coverage
|Data spatial coverage=7°N, 55°W to 60°N, 142°W
|Data temporal coverage=Time snap shot
}}
{{Dataset availability
|Data download link=http://Albert_Kettner_FTP
|Data source link=http://www.hydrosheds.org
}}
{{Data references
|Key references dataset=Lehner, B., Verdin, K., Jarvis, A. (2008): New global hydrography derived from spaceborne elevation data. Eos, Transactions, AGU, 89(10): 93-94.
}}

File:Na da 3arcsec.png

2014-01-02T15:41:50Z

Alan r: Plot of log10(drainage area), showing every 100th cell in x and y.

Plot of log10(drainage area), showing every 100th cell in x and y.

Model:IDA

2013-12-31T21:36:43Z

Alan r: Created page with "{{Model identity |Model also known as=Implicit Drainage Area |Model type=Tool }} {{Start models incorporated}} {{End a table}} {{Model identity2 |Categories=Hydrology |Spatial..."

{{Model identity
|Model also known as=Implicit Drainage Area
|Model type=Tool
}}
{{Start models incorporated}}
{{End a table}}
{{Model identity2
|Categories=Hydrology
|Spatial dimensions=2D
|Spatialscale=Continental, Regional-Scale, Landscape-Scale, Watershed-Scale
|One-line model description=An implementation of the Implicit Drainage Area method (regular and hybrid versions) for calculating drainage area from flow directions using parallel iterative solvers.
|Extended model description=IDA formulates the task of determing the drainage area, given flow directions, as a system of implicit equations. This allows the use of iterative solvers, which have the advantages of being parallelizable on distributed memory systems and widely available through libraries such as PETSc.

Using the open source PETSc library (which must be downloaded and installed separately), IDA permits large landscapes to be divided among processors, reducing total runtime and memory requirements per processor.

It is possible to reduce run time with the use of an initial guess of the drainage area. This can either be provided as a file, or use a serial algorithm on each processor to correctly determine the drainage area for the cells that do not receive flow from outside the processor's domain.

The hybrid IDA method, which is enabled with the -onlycrossborder option, uses a serial algorithm to solve for local drainage on each processor, and then only uses the parallel iterative solver to incorporate flow between processor domains. This generally results in a significant reduction in total runtime.

Currently only D8 flow directions are supported. Inputs and outputs are raw binary files.
}}
{{Start model keyword table}}
{{Model keywords
|Model keywords=drainage basin
}}
{{Model keywords
|Model keywords=watershed
}}
{{Model keywords
|Model keywords=hydrological
}}
{{Model keywords
|Model keywords=parallel computing
}}
{{End a table}}
{{Modeler information
|First name=Alan
|Last name=Richardson
|Type of contact=Model developer
|Institute / Organization=Massachusetts Institute of Technology
|Postal address 1=77 Massachusetts Ave. #54-217
|Town / City=Cambridge
|Postal code=02139
|State=Massachusetts
|Country=USA
|Email address=alan_r@mit.edu
}}
{{Model technical information
|Supported platforms=Linux
|Programming language=C
|Code optimized=Multiple Processors
|Multiple processors implemented=Distributed memory
|Start year development=2012
|Does model development still take place?=No
|End year development=2012
|Model availability=As code
|Source code availability=Through CSDMS repository
|Source web address=
|Program license type=BSD or MIT X11
|Program license type other=
}}
{{Input - Output description
|Describe input parameters=Input flow directions:
8 bit unsigned integers

The numbers corresponding to each of the 9 possible flow directions are
shown below:

32 64 128

16 0 1

8 4 2

So a cell with the value '1' means that the flow in that cell goes to the
East, while a value of '32' means that the cell's flow goes to the
North West. The value '0' implies that the cell is a sink and flow does not
leave it

Row major order is used.
|Input format=Binary
|Describe output parameters=Output drainage area, true drainage area, and initial guess:
64 bit float ('double')

Row major order is used.
The drainage area of cells with no drainage to or from them, such as ocean
cells, will be the area of the cell itself (1.0, if all cells are given
unit area).
|Output format=Binary
|Pre-processing software needed?=No
|Describe pre-processing software=
|Post-processing software needed?=No
|Describe post-processing software=
|Visualization software needed?=No
|If above answer is yes=
|Other visualization software=
}}
{{Process description model
|Describe processes represented by the model=Computation of drainage area, which, for a particular cell, is the sum of cells that drain through that cell.
|Describe key physical parameters and equations=Flow direction: the direction to the immediately neighboring cell (N,NE,E,...) to which flow from a cell is directed.
Drainage area: The size of the total number of cells that drain through a cell.
|Describe length scale and resolution constraints=Increasing the number of processors should allow larger/higher resolution landscapes to be considered.
|Describe time scale and resolution constraints=This code does not involve time.
|Describe any numerical limitations and issues=If you will be processing very large landscapes then you may need to configure PETSc with the --with-64-bit-indices option.
}}
{{Model testing
|Describe available test data sets=As an example of running IDA, and a test to ensure that it is running
correctly, a small project is provided. Unpack it using
tar -xjf example.tar.bz2

Files:
dir.bin: flow directions for a 1000 x 1000 cell landscape
true.bin: the correct answer, for comparison
run.sh: a Bash script to run the example. The script must be modified to
specify the path to the IDA executable.

Running:
Make the Bash script executable with the command chmod +x run.sh
Run the Bash script with ./run.sh
It will run IDA several times with different options, and may take some time
Depending on your configuration of PETSc, some of the runs may fail
|Model test data=Example.tar.bz2,
}}
{{Users groups model}}
{{Documentation model
|Manual model available=No
|Model manual=
}}
{{Additional comments model
|Comments=View the included README file for additional notes on compiling and running
}}
{{CSDMS staff part
|OpenMI compliant=No not possible
|CCA component=No not possible
|IRF interface=No not possible
|CMT component=Not yet
}}
{{Start coupled table}}
{{End a table}}
{{End headertab}}

{{#ifexist:Template:{{#sub:{{PAGENAME}}|0|1}}{{#sub:{{lc:{{PAGENAME}}}}|1}} download stats | ==Download statistics==
{{{{#sub:{{PAGENAME}}|0|1}}{{#sub:{{lc:{{PAGENAME}}}}|1}} download stats}} | }}

==Introduction==

== History ==

== References ==
{{Add_reference_upload_button}}
{{Add_model_references}}

== Issues ==

== Help ==
{{#ifexist:Model_help:{{PAGENAME}}|[[Model_help:{{PAGENAME}}]]|}}

== Input Files ==

== Output Files ==

File:Example.tar.bz2

2013-12-31T21:36:15Z

Alan r: A small input dataset, correct answer for comparison, and script to run.

A small input dataset, correct answer for comparison, and script to run.

User:Alan r

2013-11-07T22:27:27Z

Alan r:

{{Signup information member
|First name member=Alan
|Last name member=Richardson
|Institute member=Massachusetts inst Technology
|City member=Cambridge
|Country member=United States
|State member=Massachusetts
|Confirm email member=alan_r@mit.edu
|Working group member=Hydrology Focus Research Group
|Emaillist group member=no
}}