From 641eac4832971ce9b47a84ca7609b5977d64418b Mon Sep 17 00:00:00 2001
From: savente93 The The steps to use your own data within HydroMT are in brief: Let’s see how this works: Here, we illustrate some common GIS problems and how the functionality of the DataArray/Dataset vector accessor can be used. The data is accessed using the HydroMT DataCatalog. For more information see the Reading vector data example. Here, we illustrate some common GIS problems and how the functionality of the DataArray/Dataset raster accessor can be used. The data is accessed using the HydroMT DataCatalog. For more information see the Reading raster data example.Import packages
-2023-08-03 16:28:12,319 - basin_delineation - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:40:37,475 - basin_delineation - log - INFO - HydroMT version: 0.8.1.dev0
Read data
-2023-08-03 16:28:12,400 - basin_delineation - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:28:12,401 - basin_delineation - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:40:37,547 - basin_delineation - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:40:37,548 - basin_delineation - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
Read data
@@ -665,8 +665,8 @@
Delineate basins
-2023-08-03 16:28:17,174 - basin_delineation - basin_mask - DEBUG - Getting basin IDs at point locations.
-2023-08-03 16:28:17,301 - basin_delineation - basin_mask - INFO - basin bbox: [12.1958, 45.5850, 12.8983, 46.4167]
+2023-08-03 16:40:42,063 - basin_delineation - basin_mask - DEBUG - Getting basin IDs at point locations.
+2023-08-03 16:40:42,197 - basin_delineation - basin_mask - INFO - basin bbox: [12.1958, 45.5850, 12.8983, 46.4167]
Delineate sub-basins
-2023-08-03 16:28:22,661 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.2350, 45.7950, 12.8783, 46.4167]
+2023-08-03 16:40:47,389 - basin_delineation - basin_mask - INFO - subbasin bbox: [12.2350, 45.7950, 12.8783, 46.4167]
Delineate interbasins
-2023-08-03 16:28:29,528 - basin_delineation - basin_mask - INFO - interbasin bbox: [12.5000, 45.7200, 12.7000, 46.0000]
+2023-08-03 16:40:54,329 - basin_delineation - basin_mask - INFO - interbasin bbox: [12.5000, 45.7200, 12.7000, 46.0000]
Example: Doing Extreme Value Analysis (EVA) for time series
@@ -1279,8 +1279,8 @@
Step 2: fit a EV distribution on these peaks
@@ -1798,27 +1798,27 @@
TL;DR#
return_values (stations, rps) float64 1.426e+03 2.252e+03 ... 2.193e+03
Attributes:
long_name: discharge
- units: m3/s
PandasIndex(Index([1, 2], dtype='int32', name='stations'))
PandasIndex(Index(['shape', 'loc', 'scale'], dtype='object', name='dparams'))
PandasIndex(Index([2, 5, 25, 100, 500], dtype='int64', name='rps'))
Example: Exporting data from a data catalog
-2023-08-03 16:28:44,866 - export data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:41:10,338 - export data - log - INFO - HydroMT version: 0.8.1.dev0
Explore the current data catalog
-2023-08-03 16:28:44,935 - export data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:28:44,936 - export data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:41:10,409 - export data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:41:10,410 - export data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
artifact_data
catalog is one of the pre-defined available DataCatalog of HydroMT. You can find an overview of pre-defined data catalogs in the online user guide. You can also get an overview of the pre-defined catalogs with their version number from HydroMT.Explore the current data catalog
-2023-08-03 16:28:45,055 - export data - data_catalog - INFO - DataCatalog: Getting era5 RasterDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
-2023-08-03 16:28:45,185 - export data - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
-2023-08-03 16:28:45,188 - export data - rasterdataset - DEBUG - RasterDataset: Slicing time dim ('2010-02-02', '2010-02-15')
-2023-08-03 16:28:45,196 - export data - rasterdataset - DEBUG - RasterDataset: Convert units for 7 variables.
+2023-08-03 16:41:10,527 - export data - data_catalog - INFO - DataCatalog: Getting era5 RasterDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/era5.nc
+2023-08-03 16:41:10,659 - export data - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
+2023-08-03 16:41:10,661 - export data - rasterdataset - DEBUG - RasterDataset: Slicing time dim ('2010-02-02', '2010-02-15')
+2023-08-03 16:41:10,670 - export data - rasterdataset - DEBUG - RasterDataset: Convert units for 7 variables.
Available extent: (11.625, 45.125, 13.125, 46.875)
Available dates: 2010-02-02T00:00:00.000000000 to 2010-02-15T00:00:00.000000000
@@ -1003,14 +1003,14 @@
Explore the current data catalog
@@ -1088,7 +1088,7 @@
Explore the current data catalog
@@ -1166,7 +1166,7 @@
Explore the current data catalog
@@ -1244,7 +1244,7 @@
Explore the current data catalog
@@ -1322,7 +1322,7 @@
Explore the current data catalog
@@ -1400,7 +1400,7 @@
Explore the current data catalog
@@ -1478,7 +1478,7 @@
Explore the current data catalog
@@ -1556,11 +1556,11 @@
Explore the current data catalog
@@ -1610,15 +1610,15 @@
Export an extract of the data
-2023-08-03 16:28:45,382 - export data - data_catalog - DEBUG - Exporting merit_hydro.
-2023-08-03 16:28:45,426 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
-2023-08-03 16:28:45,736 - export data - data_catalog - DEBUG - Exporting era5.
-2023-08-03 16:28:45,756 - export data - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
-2023-08-03 16:28:45,758 - export data - rasterdataset - DEBUG - RasterDataset: Slicing time dim ('2010-02-10', '2010-02-15')
-2023-08-03 16:28:45,769 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
-2023-08-03 16:28:45,771 - export data - rasterdataset - DEBUG - RasterDataset: Convert units for 1 variables.
-2023-08-03 16:28:45,791 - export data - data_catalog - DEBUG - Exporting vito.
-2023-08-03 16:28:45,811 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2023-08-03 16:41:10,857 - export data - data_catalog - DEBUG - Exporting merit_hydro.
+2023-08-03 16:41:10,908 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2023-08-03 16:41:11,212 - export data - data_catalog - DEBUG - Exporting era5.
+2023-08-03 16:41:11,229 - export data - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
+2023-08-03 16:41:11,231 - export data - rasterdataset - DEBUG - RasterDataset: Slicing time dim ('2010-02-10', '2010-02-15')
+2023-08-03 16:41:11,238 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
+2023-08-03 16:41:11,242 - export data - rasterdataset - DEBUG - RasterDataset: Convert units for 1 variables.
+2023-08-03 16:41:11,262 - export data - data_catalog - DEBUG - Exporting vito.
+2023-08-03 16:41:11,283 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [12.000, 46.000, 13.000, 46.500] (epsg:4326))
Open and explore the exported data
-2023-08-03 16:28:45,877 - export data - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2023-08-03 16:28:45,898 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.600, 45.200, 13.000, 46.800] (epsg:4326))
+2023-08-03 16:41:11,345 - export data - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2023-08-03 16:41:11,366 - export data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.600, 45.200, 13.000, 46.800] (epsg:4326))
Example: Preparing a data catalog
-2023-08-03 16:28:56,791 - prepare data catalog - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:41:22,846 - prepare data catalog - log - INFO - HydroMT version: 0.8.1.dev0
RasterDataset from raster file
-<matplotlib.collections.QuadMesh at 0x7f76310d9750>
+<matplotlib.collections.QuadMesh at 0x7f8182c62d70>
RasterDataset from raster file
@@ -1117,7 +1117,7 @@
RasterDataset from raster file
@@ -1218,9 +1218,9 @@
RasterDataset from several raster files
-2023-08-03 16:29:01,936 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
+2023-08-03 16:41:27,970 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
dict_keys(['vito', 'merit_hydro'])
-2023-08-03 16:29:01,941 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/*.tif
+2023-08-03 16:41:27,973 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/*.tif
RasterDataset from several raster files
@@ -1663,7 +1663,7 @@
RasterDataset from several raster files
@@ -1718,7 +1718,7 @@
RasterDataset from several raster files
@@ -1733,8 +1733,8 @@
RasterDataset from several raster files float32 numpy.ndarray
+
uint8 numpy.ndarray
@@ -1773,7 +1773,7 @@ RasterDataset from several raster files
@@ -1828,7 +1828,7 @@
RasterDataset from several raster files
@@ -1843,8 +1843,8 @@
RasterDataset from several raster files float32 numpy.ndarray
+
uint8 numpy.ndarray
@@ -1883,7 +1883,7 @@ RasterDataset from several raster files
@@ -1898,8 +1898,8 @@
RasterDataset from several raster files uint8 numpy.ndarray
+
uint32 numpy.ndarray
@@ -1938,7 +1938,7 @@ RasterDataset from several raster files
@@ -1968,7 +1968,7 @@
RasterDataset from several raster files uint32 numpy.ndarray
+
float32 numpy.ndarray
@@ -1993,7 +1993,7 @@ RasterDataset from several raster files
@@ -2008,8 +2008,8 @@
RasterDataset from several raster files uint8 numpy.ndarray
+
float32 numpy.ndarray
@@ -2048,7 +2048,7 @@ RasterDataset from several raster files
@@ -2103,7 +2103,7 @@
RasterDataset from several raster filespath, the filenames can be further specified with {variable}, {year} and {month} keys to limit which files are being read based on the get_data request in the form of “path/to/my/files/{variable}{year}{month}.nc”.
RasterDataset from several raster files
-2023-08-03 16:29:02,140 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
+2023-08-03 16:41:28,171 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro.yml
dict_keys(['vito', 'merit_hydro'])
-2023-08-03 16:29:02,143 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/{variable}.tif
+2023-08-03 16:41:28,174 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.6/merit_hydro/{variable}.tif
RasterDataset from several raster files
@@ -2610,7 +2610,7 @@
RasterDataset from several raster files
@@ -2665,7 +2665,7 @@
RasterDataset from several raster files
@@ -2832,11 +2832,11 @@
RasterDataset from a netcdf file
-2023-08-03 16:29:03,455 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/era5.yml
+2023-08-03 16:41:29,580 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/era5.yml
dict_keys(['vito', 'merit_hydro', 'era5'])
-2023-08-03 16:29:03,459 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting era5 RasterDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/era5.nc
-2023-08-03 16:29:03,474 - prepare data catalog - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
-2023-08-03 16:29:03,481 - prepare data catalog - rasterdataset - DEBUG - RasterDataset: Convert units for 7 variables.
+2023-08-03 16:41:29,585 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting era5 RasterDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/era5.nc
+2023-08-03 16:41:29,601 - prepare data catalog - rasterdataset - DEBUG - RasterDataset: Shifting time labels with 86400 sec.
+2023-08-03 16:41:29,610 - prepare data catalog - rasterdataset - DEBUG - RasterDataset: Convert units for 7 variables.
RasterDataset from a netcdf file
@@ -3314,7 +3314,7 @@
RasterDataset from a netcdf file
@@ -3392,7 +3392,7 @@
RasterDataset from a netcdf file
@@ -3470,7 +3470,7 @@
RasterDataset from a netcdf file
@@ -3548,7 +3548,7 @@
RasterDataset from a netcdf file
@@ -3626,7 +3626,7 @@
RasterDataset from a netcdf file
@@ -3704,7 +3704,7 @@
RasterDataset from a netcdf file
@@ -3782,11 +3782,11 @@
RasterDataset from a netcdf file
@@ -4340,12 +4340,12 @@
GeoDataset from a netcdf file
@@ -4401,9 +4401,9 @@
GeoDataset from a netcdf file
-2023-08-03 16:29:05,540 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/gtsm.yml
+2023-08-03 16:41:31,730 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/gtsm.yml
dict_keys(['vito', 'merit_hydro', 'era5', 'rivers_lin', 'gtsm'])
-2023-08-03 16:29:05,543 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting gtsm GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/gtsmv3_eu_era5.nc
+2023-08-03 16:41:31,735 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting gtsm GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.6/gtsmv3_eu_era5.nc
GeoDataset from a netcdf file
@@ -4849,7 +4849,7 @@
GeoDataset from a netcdf file
@@ -4904,10 +4904,10 @@
GeoDataset from a netcdf file
@@ -4962,9 +4962,9 @@
GeoDataset from a netcdf file
@@ -5103,9 +5103,9 @@
GeoDataset from vector files
-2023-08-03 16:29:05,700 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/waterlevel.yml
+2023-08-03 16:41:31,895 - prepare data catalog - data_catalog - INFO - Parsing data catalog from tmpdir/waterlevel.yml
dict_keys(['vito', 'merit_hydro', 'era5', 'rivers_lin', 'gtsm', 'waterlevel_csv'])
-2023-08-03 16:29:05,702 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting waterlevel_csv GeoDataset vector data from /home/runner/work/hydromt/hydromt/docs/_examples/data/stations.csv
+2023-08-03 16:41:31,898 - prepare data catalog - data_catalog - INFO - DataCatalog: Getting waterlevel_csv GeoDataset vector data from /home/runner/work/hydromt/hydromt/docs/_examples/data/stations.csv
GeoDataset from vector files
@@ -5537,10 +5537,10 @@
GeoDataset from vector files
@@ -5595,14 +5595,14 @@
GeoDataset from vector files
-2023-08-03 16:29:11,035 - read geodataset data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:41:37,375 - read geodataset data - log - INFO - HydroMT version: 0.8.1.dev0
Example: Reading geospatial point time-series
-2023-08-03 16:29:11,102 - read geodataset data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:29:11,103 - read geodataset data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:41:37,460 - read geodataset data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:41:37,461 - read geodataset data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
Netcdf or zarr driver
-2023-08-03 16:29:11,209 - read geodataset data - data_catalog - INFO - DataCatalog: Getting gtsmv3_eu_era5 GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gtsmv3_eu_era5.nc
+2023-08-03 16:41:37,570 - read geodataset data - data_catalog - INFO - DataCatalog: Getting gtsmv3_eu_era5 GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gtsmv3_eu_era5.nc
Netcdf or zarr driver
Netcdf driver
@@ -3068,7 +3068,7 @@
Netcdf driver
@@ -3146,7 +3146,7 @@
Netcdf driver
@@ -3224,7 +3224,7 @@
Netcdf driver
@@ -3302,7 +3302,7 @@
Netcdf driver
@@ -3380,7 +3380,7 @@
Netcdf driver
@@ -3533,8 +3533,8 @@
Raster_tindex driver
-2023-08-03 16:29:27,116 - read raster data - data_catalog - INFO - DataCatalog: Getting grwl_mask RasterDataset raster_tindex data from /home/runner/.hydromt_data/artifact_data/v0.0.8/grwl_tindex.gpkg
-2023-08-03 16:29:28,509 - read raster data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [241499.448, 5023876.339, 343279.303, 5177117.241] (epsg:32633))
+2023-08-03 16:41:54,125 - read raster data - data_catalog - INFO - DataCatalog: Getting grwl_mask RasterDataset raster_tindex data from /home/runner/.hydromt_data/artifact_data/v0.0.8/grwl_tindex.gpkg
+2023-08-03 16:41:55,571 - read raster data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [241499.448, 5023876.339, 343279.303, 5177117.241] (epsg:32633))
Example: Reading 2D tabular data (DataFrame)
-2023-08-03 16:29:33,079 - tabular data example - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:42:00,451 - tabular data example - log - INFO - HydroMT version: 0.8.1.dev0
Example: Reading 2D tabular data (DataFrame)
-2023-08-03 16:29:33,092 - tabular data example - data_catalog - INFO - Parsing data catalog from data/tabular_data_catalog.yml
+2023-08-03 16:42:00,461 - tabular data example - data_catalog - INFO - Parsing data catalog from data/tabular_data_catalog.yml
time series data
-2023-08-03 16:29:33,114 - tabular data example - data_catalog - INFO - DataCatalog: Getting example_csv_data DataFrame csv data from /home/runner/work/hydromt/hydromt/docs/_examples/data/example_csv_data.csv
-2023-08-03 16:29:33,118 - tabular data example - dataframe - INFO - DataFrame: Read csv data.
+2023-08-03 16:42:00,482 - tabular data example - data_catalog - INFO - DataCatalog: Getting example_csv_data DataFrame csv data from /home/runner/work/hydromt/hydromt/docs/_examples/data/example_csv_data.csv
+2023-08-03 16:42:00,486 - tabular data example - dataframe - INFO - DataFrame: Read csv data.
reclassification table
-2023-08-03 16:29:34,047 - tabular data example - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
+2023-08-03 16:42:01,460 - tabular data example - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
reclassification table
-<matplotlib.image.AxesImage at 0x7f90141d5450>
+<matplotlib.image.AxesImage at 0x7fd7940bef50>
Example: Reading vector data
-2023-08-03 16:29:39,349 - read vector data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:42:07,250 - read vector data - log - INFO - HydroMT version: 0.8.1.dev0
Vector driver
-2023-08-03 16:29:39,526 - read vector data - data_catalog - INFO - DataCatalog: Getting gadm_level3 GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gadm_level3.gpkg
-2023-08-03 16:29:39,528 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector data.
+2023-08-03 16:42:07,450 - read vector data - data_catalog - INFO - DataCatalog: Getting gadm_level3 GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gadm_level3.gpkg
+2023-08-03 16:42:07,453 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector data.
number of rows: 509
Vector driver
-2023-08-03 16:29:39,850 - read vector data - data_catalog - INFO - DataCatalog: Getting gadm_level3 GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gadm_level3.gpkg
-2023-08-03 16:29:39,855 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector data and clip to bbox (epsg:4326) [11.557, 46.096, 11.851, 46.477].
+2023-08-03 16:42:07,812 - read vector data - data_catalog - INFO - DataCatalog: Getting gadm_level3 GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gadm_level3.gpkg
+2023-08-03 16:42:07,818 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector data and clip to bbox (epsg:4326) [11.557, 46.096, 11.851, 46.477].
number of rows: 28
Vector_table driver
-2023-08-03 16:29:40,148 - read vector data - data_catalog - INFO - DataCatalog: Getting GADM_level3_centroids GeoDataFrame vector_table data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/xy.csv
-2023-08-03 16:29:40,151 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector_table data.
+2023-08-03 16:42:08,115 - read vector data - data_catalog - INFO - DataCatalog: Getting GADM_level3_centroids GeoDataFrame vector_table data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/xy.csv
+2023-08-03 16:42:08,116 - read vector data - geodataframe - INFO - GeoDataFrame: Read vector_table data.
CRS: EPSG:4326
Example: Working with flow direction data
-2023-08-03 16:29:45,663 - flow direction data - log - INFO - HydroMT version: 0.8.1.dev0
-2023-08-03 16:29:45,723 - flow direction data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:29:45,723 - flow direction data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
-2023-08-03 16:29:45,811 - flow direction data - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2023-08-03 16:29:45,904 - flow direction data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.800, 12.800, 46.700] (epsg:4326))
+2023-08-03 16:42:13,908 - flow direction data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:42:13,967 - flow direction data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:42:13,968 - flow direction data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:42:14,061 - flow direction data - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2023-08-03 16:42:14,156 - flow direction data - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.800, 12.800, 46.700] (epsg:4326))
Example: Working with flow direction data
@@ -976,7 +976,7 @@
Example: Working with flow direction data
@@ -1031,7 +1031,7 @@
Example: Working with flow direction data
@@ -1086,7 +1086,7 @@
Example: Working with flow direction data
Derive basin and stream geometries#
@@ -1326,9 +1326,9 @@ Reproject flow direction data
-2023-08-03 16:30:05,455 - flow direction data - flw - INFO - Deriving flow direction from reprojected synthethic elevation.
-2023-08-03 16:30:09,069 - flow direction data - flw - INFO - Calculating upstream area with 0 river inflows.
-2023-08-03 16:30:09,689 - flow direction data - flw - DEBUG - New/org max upstream area: 3964.90/3953.29 km2
+2023-08-03 16:42:34,287 - flow direction data - flw - INFO - Deriving flow direction from reprojected synthethic elevation.
+2023-08-03 16:42:37,709 - flow direction data - flw - INFO - Calculating upstream area with 0 river inflows.
+2023-08-03 16:42:38,336 - flow direction data - flw - DEBUG - New/org max upstream area: 3964.90/3953.29 km2
Example: Working with geodatasets
-2023-08-03 16:30:36,491 - raster data - log - INFO - HydroMT version: 0.8.1.dev0
-2023-08-03 16:30:36,547 - raster data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:30:36,547 - raster data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:43:05,208 - raster data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:43:05,267 - raster data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:43:05,268 - raster data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
Geospatial attributes
-2023-08-03 16:30:36,644 - raster data - data_catalog - INFO - DataCatalog: Getting gtsmv3_eu_era5 GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gtsmv3_eu_era5.nc
+2023-08-03 16:43:05,369 - raster data - data_catalog - INFO - DataCatalog: Getting gtsmv3_eu_era5 GeoDataset netcdf data from /home/runner/.hydromt_data/artifact_data/v0.0.8/gtsmv3_eu_era5.nc
Conversion
@@ -1131,9 +1131,9 @@
Conversion
[10]:
@@ -1532,7 +1532,7 @@
Conversion
@@ -1587,12 +1587,12 @@
Conversion
[11]:
@@ -2013,7 +2013,7 @@
Conversion
@@ -2068,12 +2068,12 @@
Conversion
@@ -2497,7 +2497,7 @@
I/O (Internal and External)
[13]:
diff --git a/dev/_examples/working_with_models.html b/dev/_examples/working_with_models.html
index be285f046..2d67467c8 100644
--- a/dev/_examples/working_with_models.html
+++ b/dev/_examples/working_with_models.html
@@ -505,7 +505,7 @@
Example: Working with models in Python
-2023-08-03 16:30:42,499 - working with models - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:43:11,825 - working with models - log - INFO - HydroMT version: 0.8.1.dev0
Model components
Model setup_* methods
-2023-08-03 16:30:42,838 - working with models - model_grid - INFO - Preparing 2D grid.
-2023-08-03 16:30:42,839 - working with models - basin_mask - DEBUG - Parsed region (kind=subbasin): {'uparea': 50, 'xy': [12.2051, 45.8331]}
-2023-08-03 16:30:42,839 - working with models - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2023-08-03 16:30:43,094 - working with models - basin_mask - DEBUG - Getting basin IDs at point locations.
-2023-08-03 16:30:47,630 - working with models - basin_mask - INFO - subbasin bbox: [11.7750, 45.8042, 12.7450, 46.6900]
-2023-08-03 16:30:47,700 - working with models - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
-2023-08-03 16:30:47,723 - working with models - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.775, 45.804, 12.745, 46.690] (epsg:4326))
+2023-08-03 16:43:12,181 - working with models - model_grid - INFO - Preparing 2D grid.
+2023-08-03 16:43:12,182 - working with models - basin_mask - DEBUG - Parsed region (kind=subbasin): {'uparea': 50, 'xy': [12.2051, 45.8331]}
+2023-08-03 16:43:12,183 - working with models - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2023-08-03 16:43:12,440 - working with models - basin_mask - DEBUG - Getting basin IDs at point locations.
+2023-08-03 16:43:17,160 - working with models - basin_mask - INFO - subbasin bbox: [11.7750, 45.8042, 12.7450, 46.6900]
+2023-08-03 16:43:17,232 - working with models - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2023-08-03 16:43:17,256 - working with models - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.775, 45.804, 12.745, 46.690] (epsg:4326))
{'region': geometry value
0 POLYGON ((304637.761 5173886.488, 304634.754 5... 1.0}
<xarray.Dataset>
@@ -1104,8 +1104,8 @@
Model setup_* methods
-2023-08-03 16:30:48,778 - working with models - model_api - DEBUG - Setting model config options.
-2023-08-03 16:30:48,779 - working with models - model_api - ERROR - Default config file not found at grid_model/model.ini
+2023-08-03 16:43:18,385 - working with models - model_api - DEBUG - Setting model config options.
+2023-08-03 16:43:18,388 - working with models - model_api - ERROR - Default config file not found at grid_model/model.ini
Build a model from CLI
-2023-08-03 16:31:23,359 - build - log - DEBUG - Writing log messages to new file /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/hydromt.log.
-2023-08-03 16:31:23,360 - build - log - INFO - HydroMT version: 0.8.1.dev0
-2023-08-03 16:31:23,360 - build - main - INFO - Building instance of grid_model model at /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1.
-2023-08-03 16:31:23,360 - build - main - INFO - User settings:
-2023-08-03 16:31:23,437 - build - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:31:23,437 - build - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
-2023-08-03 16:31:23,529 - build - data_catalog - INFO - Parsing data catalog from data/vito_reclass.yml
-2023-08-03 16:31:23,531 - build - model_api - INFO - Initializing grid_model model from hydromt (v0.8.1.dev0).
-2023-08-03 16:31:23,531 - build - model_api - DEBUG - Setting model config options.
-2023-08-03 16:31:23,531 - build - model_api - ERROR - Default config file not found at grid_model/model.ini
-2023-08-03 16:31:23,531 - build - model_api - INFO - setup_grid.region: {'bbox': [11.7, 45.35, 12.95, 46.7]}
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.res: 0.05
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.crs: 4326
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.rotated: False
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.hydrography_fn: merit_hydro
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.basin_index_fn: merit_hydro_index
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.add_mask: True
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.align: True
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.dec_origin: 0
-2023-08-03 16:31:23,532 - build - model_api - INFO - setup_grid.dec_rotation: 3
-2023-08-03 16:31:23,532 - build - model_grid - INFO - Preparing 2D grid.
-2023-08-03 16:31:23,532 - build - basin_mask - DEBUG - Parsed region (kind=bbox): {'bbox': [11.7, 45.35, 12.95, 46.7]}
-2023-08-03 16:31:23,557 - build - model_api - INFO - setup_grid_from_constant.constant: 0.01
-2023-08-03 16:31:23,557 - build - model_api - INFO - setup_grid_from_constant.name: c1
-2023-08-03 16:31:23,557 - build - model_api - INFO - setup_grid_from_constant.dtype: float32
-2023-08-03 16:31:23,557 - build - model_api - INFO - setup_grid_from_constant.nodata: -99.0
-2023-08-03 16:31:23,557 - build - model_api - INFO - setup_grid_from_constant.mask_name: mask
-2023-08-03 16:31:23,563 - build - model_api - INFO - setup_grid_from_rasterdataset.raster_fn: merit_hydro_1k
-2023-08-03 16:31:23,564 - build - model_api - INFO - setup_grid_from_rasterdataset.variables: ['elevtn', 'basins']
-2023-08-03 16:31:23,564 - build - model_api - INFO - setup_grid_from_rasterdataset.fill_method: None
-2023-08-03 16:31:23,564 - build - model_api - INFO - setup_grid_from_rasterdataset.reproject_method: ['average', 'mode']
-2023-08-03 16:31:23,564 - build - model_api - INFO - setup_grid_from_rasterdataset.mask_name: mask
-2023-08-03 16:31:23,564 - build - model_api - INFO - setup_grid_from_rasterdataset.rename: {}
-2023-08-03 16:31:23,564 - build - model_grid - INFO - Preparing grid data from raster source merit_hydro_1k
-2023-08-03 16:31:23,564 - build - data_catalog - INFO - DataCatalog: Getting merit_hydro_1k RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro_1k/{variable}.tif
-2023-08-03 16:31:23,634 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.raster_fn: vito
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.variables: None
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.fill_method: nearest
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.reproject_method: mode
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.mask_name: mask
-2023-08-03 16:31:23,745 - build - model_api - INFO - setup_grid_from_rasterdataset.rename: {'vito': 'landuse'}
-2023-08-03 16:31:23,745 - build - model_grid - INFO - Preparing grid data from raster source vito
-2023-08-03 16:31:23,746 - build - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
-2023-08-03 16:31:23,767 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
-2023-08-03 16:31:24,024 - build - model_api - INFO - setup_grid_from_raster_reclass.raster_fn: vito
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.reclass_table_fn: vito_reclass
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.reclass_variables: ['manning']
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.variable: None
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.fill_method: None
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.reproject_method: ['average']
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.mask_name: mask
-2023-08-03 16:31:24,025 - build - model_api - INFO - setup_grid_from_raster_reclass.rename: {}
-2023-08-03 16:31:24,025 - build - model_grid - INFO - Preparing grid data by reclassifying the data in vito based on vito_reclass
-2023-08-03 16:31:24,026 - build - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
-2023-08-03 16:31:24,049 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
-2023-08-03 16:31:24,050 - build - data_catalog - INFO - DataCatalog: Getting vito_reclass DataFrame csv data from /home/runner/work/hydromt/hydromt/docs/_examples/data/vito_reclass.csv
-2023-08-03 16:31:24,051 - build - dataframe - INFO - DataFrame: Read csv data.
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.vector_fn: hydro_lakes
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.variables: ['waterbody_id', 'Depth_avg']
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.nodata: [-1, -999.0]
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.rasterize_method: value
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.mask_name: mask
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.rename: {'waterbody_id': 'lake_id', 'Detph_avg': 'lake_depth'}
-2023-08-03 16:31:24,116 - build - model_api - INFO - setup_grid_from_geodataframe.all_touched: True
-2023-08-03 16:31:24,116 - build - model_grid - INFO - Preparing grid data from vector 'hydro_lakes'.
-2023-08-03 16:31:24,120 - build - data_catalog - INFO - DataCatalog: Getting hydro_lakes GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/hydro_lakes.gpkg
-2023-08-03 16:31:24,122 - build - geodataframe - INFO - GeoDataFrame: Read vector data and clip to geom (epsg:4326) [11.700, 45.350, 12.950, 46.700].
-2023-08-03 16:31:24,188 - build - geodataframe - DEBUG - GeoDataFrame: Convert units for 1 columns.
-2023-08-03 16:31:24,221 - build - model_api - INFO - setup_grid_from_geodataframe.vector_fn: hydro_lakes
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.variables: None
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.nodata: -1
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.rasterize_method: fraction
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.mask_name: mask
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.rename: {'hydro_lakes': 'water_frac'}
-2023-08-03 16:31:24,222 - build - model_api - INFO - setup_grid_from_geodataframe.all_touched: True
-2023-08-03 16:31:24,222 - build - model_grid - INFO - Preparing grid data from vector 'hydro_lakes'.
-2023-08-03 16:31:24,226 - build - data_catalog - INFO - DataCatalog: Getting hydro_lakes GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/hydro_lakes.gpkg
-2023-08-03 16:31:24,227 - build - geodataframe - INFO - GeoDataFrame: Read vector data and clip to geom (epsg:4326) [11.700, 45.350, 12.950, 46.700].
-2023-08-03 16:31:24,265 - build - geodataframe - DEBUG - GeoDataFrame: Convert units for 1 columns.
-2023-08-03 16:31:24,366 - build - model_api - INFO - write.components: ['config', 'geoms', 'grid']
-2023-08-03 16:31:24,366 - build - model_api - INFO - Writing model data to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1
-2023-08-03 16:31:24,366 - build - model_api - INFO - Writing model config to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/model.ini
-2023-08-03 16:31:24,366 - build - model_api - DEBUG - Writing file geoms/region.geojson
-2023-08-03 16:31:24,376 - build - model_api - DEBUG - Writing file grid/grid.nc
-2023-08-03 16:31:24,793 - build - model_api - INFO - Writing model data to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1
-2023-08-03 16:31:24,793 - build - model_api - INFO - Writing model config to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/model.ini
-2023-08-03 16:31:24,794 - build - model_api - DEBUG - Writing file grid/grid.nc
-2023-08-03 16:31:25,097 - build - model_api - DEBUG - Writing file geoms/region.geojson
-2023-08-03 16:31:25,108 - build - model_api - DEBUG - No forcing data found, skip writing.
-2023-08-03 16:31:25,108 - build - model_api - DEBUG - No states data found, skip writing.
+2023-08-03 16:43:54,439 - build - log - DEBUG - Writing log messages to new file /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/hydromt.log.
+2023-08-03 16:43:54,439 - build - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:43:54,439 - build - main - INFO - Building instance of grid_model model at /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1.
+2023-08-03 16:43:54,439 - build - main - INFO - User settings:
+2023-08-03 16:43:54,521 - build - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:43:54,522 - build - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:43:54,607 - build - data_catalog - INFO - Parsing data catalog from data/vito_reclass.yml
+2023-08-03 16:43:54,609 - build - model_api - INFO - Initializing grid_model model from hydromt (v0.8.1.dev0).
+2023-08-03 16:43:54,609 - build - model_api - DEBUG - Setting model config options.
+2023-08-03 16:43:54,609 - build - model_api - ERROR - Default config file not found at grid_model/model.ini
+2023-08-03 16:43:54,609 - build - model_api - INFO - setup_grid.region: {'bbox': [11.7, 45.35, 12.95, 46.7]}
+2023-08-03 16:43:54,609 - build - model_api - INFO - setup_grid.res: 0.05
+2023-08-03 16:43:54,609 - build - model_api - INFO - setup_grid.crs: 4326
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.rotated: False
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.hydrography_fn: merit_hydro
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.basin_index_fn: merit_hydro_index
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.add_mask: True
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.align: True
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.dec_origin: 0
+2023-08-03 16:43:54,610 - build - model_api - INFO - setup_grid.dec_rotation: 3
+2023-08-03 16:43:54,610 - build - model_grid - INFO - Preparing 2D grid.
+2023-08-03 16:43:54,610 - build - basin_mask - DEBUG - Parsed region (kind=bbox): {'bbox': [11.7, 45.35, 12.95, 46.7]}
+2023-08-03 16:43:54,634 - build - model_api - INFO - setup_grid_from_constant.constant: 0.01
+2023-08-03 16:43:54,634 - build - model_api - INFO - setup_grid_from_constant.name: c1
+2023-08-03 16:43:54,634 - build - model_api - INFO - setup_grid_from_constant.dtype: float32
+2023-08-03 16:43:54,634 - build - model_api - INFO - setup_grid_from_constant.nodata: -99.0
+2023-08-03 16:43:54,634 - build - model_api - INFO - setup_grid_from_constant.mask_name: mask
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.raster_fn: merit_hydro_1k
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.variables: ['elevtn', 'basins']
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.fill_method: None
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.reproject_method: ['average', 'mode']
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.mask_name: mask
+2023-08-03 16:43:54,641 - build - model_api - INFO - setup_grid_from_rasterdataset.rename: {}
+2023-08-03 16:43:54,641 - build - model_grid - INFO - Preparing grid data from raster source merit_hydro_1k
+2023-08-03 16:43:54,642 - build - data_catalog - INFO - DataCatalog: Getting merit_hydro_1k RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro_1k/{variable}.tif
+2023-08-03 16:43:54,718 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.raster_fn: vito
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.variables: None
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.fill_method: nearest
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.reproject_method: mode
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.mask_name: mask
+2023-08-03 16:43:54,836 - build - model_api - INFO - setup_grid_from_rasterdataset.rename: {'vito': 'landuse'}
+2023-08-03 16:43:54,836 - build - model_grid - INFO - Preparing grid data from raster source vito
+2023-08-03 16:43:54,837 - build - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
+2023-08-03 16:43:54,859 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
+2023-08-03 16:43:55,141 - build - model_api - INFO - setup_grid_from_raster_reclass.raster_fn: vito
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.reclass_table_fn: vito_reclass
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.reclass_variables: ['manning']
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.variable: None
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.fill_method: None
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.reproject_method: ['average']
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.mask_name: mask
+2023-08-03 16:43:55,142 - build - model_api - INFO - setup_grid_from_raster_reclass.rename: {}
+2023-08-03 16:43:55,142 - build - model_grid - INFO - Preparing grid data by reclassifying the data in vito based on vito_reclass
+2023-08-03 16:43:55,143 - build - data_catalog - INFO - DataCatalog: Getting vito RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/vito.tif
+2023-08-03 16:43:55,168 - build - rasterdataset - DEBUG - RasterDataset: Clip with bbox - [11.700, 45.350, 12.950, 46.700] (epsg:4326))
+2023-08-03 16:43:55,170 - build - data_catalog - INFO - DataCatalog: Getting vito_reclass DataFrame csv data from /home/runner/work/hydromt/hydromt/docs/_examples/data/vito_reclass.csv
+2023-08-03 16:43:55,170 - build - dataframe - INFO - DataFrame: Read csv data.
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.vector_fn: hydro_lakes
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.variables: ['waterbody_id', 'Depth_avg']
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.nodata: [-1, -999.0]
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.rasterize_method: value
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.mask_name: mask
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.rename: {'waterbody_id': 'lake_id', 'Detph_avg': 'lake_depth'}
+2023-08-03 16:43:55,237 - build - model_api - INFO - setup_grid_from_geodataframe.all_touched: True
+2023-08-03 16:43:55,238 - build - model_grid - INFO - Preparing grid data from vector 'hydro_lakes'.
+2023-08-03 16:43:55,242 - build - data_catalog - INFO - DataCatalog: Getting hydro_lakes GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/hydro_lakes.gpkg
+2023-08-03 16:43:55,243 - build - geodataframe - INFO - GeoDataFrame: Read vector data and clip to geom (epsg:4326) [11.700, 45.350, 12.950, 46.700].
+2023-08-03 16:43:55,311 - build - geodataframe - DEBUG - GeoDataFrame: Convert units for 1 columns.
+2023-08-03 16:43:55,345 - build - model_api - INFO - setup_grid_from_geodataframe.vector_fn: hydro_lakes
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.variables: None
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.nodata: -1
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.rasterize_method: fraction
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.mask_name: mask
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.rename: {'hydro_lakes': 'water_frac'}
+2023-08-03 16:43:55,346 - build - model_api - INFO - setup_grid_from_geodataframe.all_touched: True
+2023-08-03 16:43:55,346 - build - model_grid - INFO - Preparing grid data from vector 'hydro_lakes'.
+2023-08-03 16:43:55,350 - build - data_catalog - INFO - DataCatalog: Getting hydro_lakes GeoDataFrame vector data from /home/runner/.hydromt_data/artifact_data/v0.0.8/hydro_lakes.gpkg
+2023-08-03 16:43:55,351 - build - geodataframe - INFO - GeoDataFrame: Read vector data and clip to geom (epsg:4326) [11.700, 45.350, 12.950, 46.700].
+2023-08-03 16:43:55,389 - build - geodataframe - DEBUG - GeoDataFrame: Convert units for 1 columns.
+2023-08-03 16:43:55,492 - build - model_api - INFO - write.components: ['config', 'geoms', 'grid']
+2023-08-03 16:43:55,492 - build - model_api - INFO - Writing model data to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1
+2023-08-03 16:43:55,492 - build - model_api - INFO - Writing model config to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/model.ini
+2023-08-03 16:43:55,493 - build - model_api - DEBUG - Writing file geoms/region.geojson
+2023-08-03 16:43:55,503 - build - model_api - DEBUG - Writing file grid/grid.nc
+2023-08-03 16:43:55,930 - build - model_api - INFO - Writing model data to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1
+2023-08-03 16:43:55,930 - build - model_api - INFO - Writing model config to /home/runner/work/hydromt/hydromt/docs/_examples/tmp_grid_model1/model.ini
+2023-08-03 16:43:55,931 - build - model_api - DEBUG - Writing file grid/grid.nc
+2023-08-03 16:43:56,220 - build - model_api - DEBUG - Writing file geoms/region.geojson
+2023-08-03 16:43:56,232 - build - model_api - DEBUG - No forcing data found, skip writing.
+2023-08-03 16:43:56,232 - build - model_api - DEBUG - No states data found, skip writing.
Build a model from CLI
-<matplotlib.collections.QuadMesh at 0x7ff9228ab9a0>
+<matplotlib.collections.QuadMesh at 0x7f4b1b007ac0>
Example: Working with raster data
-2023-08-03 16:31:38,328 - raster data - log - INFO - HydroMT version: 0.8.1.dev0
-2023-08-03 16:31:38,386 - raster data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:31:38,387 - raster data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:44:10,469 - raster data - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:44:10,531 - raster data - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:44:10,532 - raster data - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
Geospatial attributes
-2023-08-03 16:31:38,483 - raster data - data_catalog - INFO - DataCatalog: Getting ghs_pop_2015 RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/ghs_pop_2015.tif
+2023-08-03 16:44:10,629 - raster data - data_catalog - INFO - DataCatalog: Getting ghs_pop_2015 RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/ghs_pop_2015.tif
Geospatial attributes
-<matplotlib.collections.QuadMesh at 0x7fcd804b50c0>
+<matplotlib.collections.QuadMesh at 0x7fa39d61ab00>
Reproject (warp) raster data
-<matplotlib.collections.QuadMesh at 0x7fcd81071960>
+<matplotlib.collections.QuadMesh at 0x7fa39e1d74c0>
Interpolate nodata values
-<matplotlib.collections.QuadMesh at 0x7fcd684f13f0>
+<matplotlib.collections.QuadMesh at 0x7fa3842805e0>
Interpolate nodata values
-<matplotlib.collections.QuadMesh at 0x7fcd6840c3d0>
+<matplotlib.collections.QuadMesh at 0x7fa38533d150>
Reproject and merge
-<matplotlib.collections.QuadMesh at 0x7fcd683bfe50>
+<matplotlib.collections.QuadMesh at 0x7fa385572320>
Reproject and merge
-<matplotlib.collections.QuadMesh at 0x7fcd685e4a60>
+<matplotlib.collections.QuadMesh at 0x7fa38566dbd0>
Example: Reading tiled raster data with different zoom levels
-2023-08-03 16:32:08,580 - tiling - log - INFO - HydroMT version: 0.8.1.dev0
-2023-08-03 16:32:08,637 - tiling - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
-2023-08-03 16:32:08,638 - tiling - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
-2023-08-03 16:32:08,735 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
+2023-08-03 16:44:40,765 - tiling - log - INFO - HydroMT version: 0.8.1.dev0
+2023-08-03 16:44:40,824 - tiling - data_catalog - INFO - Reading data catalog artifact_data v0.0.8 from archive
+2023-08-03 16:44:40,826 - tiling - data_catalog - INFO - Parsing data catalog from /home/runner/.hydromt_data/artifact_data/v0.0.8/data_catalog.yml
+2023-08-03 16:44:40,913 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro RasterDataset raster data from /home/runner/.hydromt_data/artifact_data/v0.0.8/merit_hydro/{variable}.tif
reading tiled raster data with zoom levels
-2023-08-03 16:32:11,399 - tiling - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro_xyz/merit_hydro_xyz.yml
+2023-08-03 16:44:43,553 - tiling - data_catalog - INFO - Parsing data catalog from tmpdir/merit_hydro_xyz/merit_hydro_xyz.yml
reading tiled raster data with zoom levels
-2023-08-03 16:32:11,411 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
+2023-08-03 16:44:43,568 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
reading tiled raster data with zoom levels
-2023-08-03 16:32:11,495 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
+2023-08-03 16:44:43,651 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
(60, 53)
Caching tiled raster datasets
-2023-08-03 16:32:12,768 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
-2023-08-03 16:32:12,777 - tiling - caching - INFO - Downloading 56 tiles to /home/runner/.hydromt_data/merit_hydro_xyz/merit_hydro_xyz
+2023-08-03 16:44:44,904 - tiling - data_catalog - INFO - DataCatalog: Getting merit_hydro_xyz RasterDataset raster data from /home/runner/work/hydromt/hydromt/docs/_examples/tmpdir/merit_hydro_xyz/merit_hydro_xyz_zl{zoom_level}.vrt
+2023-08-03 16:44:44,916 - tiling - caching - INFO - Downloading 56 tiles to /home/runner/.hydromt_data/merit_hydro_xyz/merit_hydro_xyz
hydromt.Model{'r','r+','w'}, optional) – read/append/write mode, by default “w”
config_fn (str
, optional) – Model simulation configuration file, by default None.
Note that this is not the HydroMT model setup configuration file!
data_libs (List[str]
, optional) – List of data catalog yaml files, by default None
data_libs (List[str]
, optional) – List of data catalog configuration files, by default None
**artifact_keys – Additional keyword arguments to be passed down.
logger – The logger to be used.
config_fn (str
, optional) – Model simulation configuration file, by default None.
Note that this is not the HydroMT model setup configuration file!
data_libs (List[str]
, optional) – List of data catalog yaml files, by default None
data_libs (List[str]
, optional) – List of data catalog configuration files, by default None
**artifact_keys – Additional keyword arguments to be passed down.
logger – The logger to be used.
root (str
, Path
, optional) – Global root for all relative paths in yaml file.
+
root (str
, Path
, optional) – Global root for all relative paths in configuration file.
If “auto” the data source paths are relative to the yaml output path
.
data_lib_fn (str
, Path
, optional) – Path of output yml file, absolute or relative to the model root,
by default “hydromt_data.yml”.
meta:
- root: <path>
- category: <category>
- version: <version>
-<name>:
- path: <path>
- data_type: <data_type>
- driver: <driver>
- filesystem: <filesystem>
- driver_kwargs:
- <key>: <value>
- nodata:
- <hydromt_variable_name1>: <nodata>
- rename:
- <native_variable_name1>: <hydromt_variable_name1>
- <native_variable_name2>: <hydromt_variable_name2>
- unit_add:
- <hydromt_variable_name1>: <float/int>
- unit_mult:
- <hydromt_variable_name1>: <float/int>
- meta:
- source_url: <source_url>
- source_version: <source_version>
- source_licence: <source_licence>
- paper_ref: <paper_ref>
- paper_doi: <paper_doi>
- placeholders:
- <placeholder_name_1>: <list of names>
- <placeholder_name_2>: <list of names>
+meta:
+ root: <path>
+ category: <category>
+ version: <version>
+<name>:
+ path: <path>
+ data_type: <data_type>
+ driver: <driver>
+ filesystem: <filesystem>
+ driver_kwargs:
+ <key>: <value>
+ nodata:
+ <hydromt_variable_name1>: <nodata>
+ rename:
+ <native_variable_name1>: <hydromt_variable_name1>
+ <native_variable_name2>: <hydromt_variable_name2>
+ unit_add:
+ <hydromt_variable_name1>: <float/int>
+ unit_mult:
+ <hydromt_variable_name1>: <float/int>
+ meta:
+ source_url: <source_url>
+ source_version: <source_version>
+ source_licence: <source_licence>
+ paper_ref: <paper_ref>
+ paper_doi: <paper_doi>
+ placeholders:
+ <placeholder_name_1>: <list of names>
+ <placeholder_name_2>: <list of names>
data_libs ((list of) str
, Path
, optional) – One or more paths to data catalog yaml files or names of predefined data
-catalogs. By default the data catalog is initiated without data entries.
-See from_yml()
for
+
data_libs ((list of) str
, Path
, optional) – One or more paths to data catalog configuration files or names of predefined
+data catalogs. By default the data catalog is initiated without data
+entries. See from_yml()
for
accepted yaml format.
fallback_lib – Name of pre-defined data catalog to read if no data_libs are provided, by default ‘artifact_data’. @@ -897,9 +897,9 @@
data_libs ((list of) str
, Path
, optional) – One or more paths to data catalog yaml files or names of predefined data
-catalogs. By default the data catalog is initiated without data entries.
-See from_yml()
for
+
data_libs ((list of) str
, Path
, optional) – One or more paths to data catalog configuration files or names of predefined
+data catalogs. By default the data catalog is initiated without data
+entries. See from_yml()
for
accepted yaml format.
fallback_lib – Name of pre-defined data catalog to read if no data_libs are provided, by default ‘artifact_data’. diff --git a/dev/_generated/hydromt.data_catalog.DataCatalog.to_dict.html b/dev/_generated/hydromt.data_catalog.DataCatalog.to_dict.html index 1aeb7d1bd..089069d56 100644 --- a/dev/_generated/hydromt.data_catalog.DataCatalog.to_dict.html +++ b/dev/_generated/hydromt.data_catalog.DataCatalog.to_dict.html @@ -871,7 +871,7 @@
source_names (list
, optional) – List of source names to export, by default None in which case all sources
are exported.
root (str
, Path
, optional) – Global root for all relative paths in yml file.
root (str
, Path
, optional) – Global root for all relative paths in the file.
meta (dict
, optional) – key-value pairs to add to the data catalog meta section, such as ‘version’,
by default empty.
Rp;iwj{fPlG&JOvFt
z2l6EC&4gcberf6K{Cw`rzT5G#l&E^S>(QcEvOrUdX9h=HH3BdE5d(;w+;GwZl=XZ0KHQ~+0D4U^N><)eL*N6eDDJP?>Qd2)e$eNuKYM5@2lbwNg+xzd9w*o^VY##9y=wHg_o
zq0C3C4?KY$+gzG0<*WgD)YlZWuk+{3f0!SikY&RL?K$!*NDIx2@-1V;7K
9eu00VM2)*~qtxvH2%knQSVd3{D^uG@f#uGl7
zJ6$%KJU^h5HT9}PbFi5
nB}UY@=i~`m+8rMq*6qoV6yp}Y+d>d(#YZ|N!=J`c|lV*92}pbTZ@z(
zr8ui9(j+1bLY(U$A%UMTn{}JJm4YydP@bSRe+^QA)PK;SwzauKm3IYy>EeL#cnHQ&
zWGim%-RE>Z!zzJukQD{O(rq4L1c4yWi_Qbz8XB$Xk6vKBo-m(&idOeA#s?htZavTR
zY@KU2{xgi$B#}@2eg#o%Y;K@kLyO1Re8qfOV6|g3>hstmkFvFOflq($_c2=QBc$QA
zH*dbp^B?{=7cX4k)z`jB*(^DkP1!#>#(5r1)2Xj?H6vS8L_x%2IX`!KjaXaX;Nb9(
zi!oatMl`0PYDy++6Kr8