Skip to content

Commit

Permalink
Revert "Delete _datasets/json directory"
Browse files Browse the repository at this point in the history 
This reverts commit 7dbe55f.
  • Loading branch information
@matamadio
matamadio committed Sep 24, 2024
1 parent f2e881c commit a349316
Show file tree
Hide file tree
Showing 38 changed files with 11,928 additions and 0 deletions.
105 changes: 105 additions & 0 deletions _datasets/json/WSF_19.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,105 @@
{
"datasets": [
{
"id": "WSF_19",
"title": "World Settlement Footprint 2019",
"description": "The World Settlement Footprint (WSF®) 2019 is a 10m resolution binary mask outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery.",
"risk_data_type": [
"exposure"
],
"publisher": {
"name": "DLR",
"url": "https://geoservice.dlr.de/"
},
"version": "R2019",
"project": "World Settlement Footprint (WSF®)",
"details": "Based on the hypothesis that settlements generally show a more stable behavior with respect to most land-cover classes, temporal statistics are calculated for both S1- and S2-based indices. In particular, a comprehensive analysis has been performed by exploiting a number of reference building outlines to identify the most suitable set of temporal features (ultimately including 6 from S1 and 25 from S2). Training points for the settlement and non-settlement class are then generated by thresholding specific features, which varies depending on the 30 climate types of the well-established Köppen Geiger scheme. Next, binary classification based on Random Forest is applied and, finally, a dedicated post-processing is performed where ancillary datasets are employed to further reduce omission and commission errors. Here, the whole classification process has been entirely carried out within the Google Earth Engine platform. To assess the high accuracy and reliability of the WSF2019, two independent crowd-sourcing-based validation exercises have been carried out with the support of Google and Mapswipe, respectively, where overall 1M reference labels have been collected based photointerpretation of very high-resolution optical imagery.",
"spatial": {
"scale": "global"
},
"license": "CC-BY-4.0",
"contact_point": {
"name": "WSF team",
"email": "wsf@dlr.de",
"url": "https://geoservice.dlr.de/web/datasets/wsf_2019"
},
"creator": {
"name": "Mattia Marconcini"
},
"exposure": {
"category": "buildings",
"metrics": [
{
"id": "1",
"dimension": "structure",
"quantity_kind": "area"
}
]
},
"attributions": [
{
"id": "0",
"entity": {
"name": "Mattia Marconcini",
"email": "mattia.marconcini@dlr.de"
},
"role": "author"
},
{
"id": "1",
"entity": {
"name": "EOC Geoservice",
"email": "geoservice@dlr.de",
"url": "https://geoservice.dlr.de/web/contact"
},
"role": "resource_provider"
},
{
"id": "2",
"entity": {
"name": "WSF team",
"email": "wsf@dlr.de"
},
"role": "processor"
}
],
"referenced_by": [
{
"id": "0",
"name": "Understanding Current Trends in Global Urbanisation - The World Settlement Footprint Suite",
"author_names": [
"Mattia Marconcini",
"Annekatrin Metz-Marconcini",
"Thomas Esch",
"Noel Gorelick"
],
"date_published": "2021-01-01",
"url": "https://austriaca.at/0xc1aa5576%200x003c9b4c.pdf",
"doi": "10.1553/giscience2021_01_s33"
}
],
"resources": [
{
"id": "0",
"title": "World Settlement Footprint (WSF) 2019",
"description": "Binary mask at 10m resolution outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery. ",
"format": "geotiff",
"spatial_resolution": 10,
"coordinate_system": "EPSG:4326",
"access_url": "https://geoservice.dlr.de/web/maps/eoc:wsf2019",
"download_url": "https://download.geoservice.dlr.de/WSF2019/",
"temporal": {
"start": "2019",
"end": "2019"
}
}
],
"links": [
{
"href": "https://docs.riskdatalibrary.org/en/0__2__0/rdls_schema.json",
"rel": "describedby"
}
]
}
]
}
107 changes: 107 additions & 0 deletions _datasets/json/WSF_EVO.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,107 @@
{
"datasets": [
{
"id": "WSF_evo",
"title": "World Settlement Footprint Evolution",
"description": "The World Settlement Footprint (WSF®) Evolution is a 30m resolution dataset outlining the global settlement extent on a yearly basis from 1985 to 2015.",
"risk_data_type": [
"exposure"
],
"publisher": {
"name": "DLR",
"url": "https://geoservice.dlr.de/"
},
"version": "R2019",
"project": "World Settlement Footprint (WSF®)",
"details": "Based on the assumption that settlement growth occurred over time, all pixels categorized as non-settlement in the WSF2015 (Marconcini et al., 2020) are excluded a priori from the analysis. Next, for each target year in the past, all available Landsat-5/7 scenes acquired over the given area of interest are gathered and key temporal statistics (i.e., temporal mean, minimum, maximum, etc.) are then extracted for different spectral indices. Among others, these include: the normalized difference built-up index (NDBI), normalized difference vegetation index (NDVI) and modified normalized difference water index (MNDWI). Temporal features proved generally robust if computed over at least 7 clear cloud-/cloud-shadow-free observations; accordingly, if for a given pixel in the target year this constraint is not satisfied, the time frame is enlarged backwards (at 1-year steps) as long as the condition is met.\nStarting backwards from the year 2015 - for which the WSF2015 is used as a reference - settlement and non-settlement training samples for the given target year t are iteratively extracted by applying morphological filtering to the settlement mask derived for the year t+1, as well as excluding potentially mislabeled samples by adaptively thresholding the temporal mean NDBI, MNDWI and NDVI. Finally, binary Random Forest classification in performed.\nTo quantitatively assess the high accuracy and reliability of the dataset, an extensive campaign based on crowdsourcing photointerpretation of very high-resolution airborne and satellite historical imagery has been performed with the support of Google. In particular, for the years 1990, 1995, 2000, 2005, 2010 and 2015, ~200K reference cells of 30x30m size distributed over 100 sites around the world have been labelled, hence summing up to overall ~1.2M validation samples.\nIt is worth noting that past Landsat-5/7 availability considerably varies across the world and over time. Independently from the implemented approach, this might then result in a lower quality of the final product where few/no scenes have been collected. Accordingly, to provide the users with a suitable and intuitive measure that accounts for the goodness of the Landsat imagery, we conceived the Input Data Consistency (IDC) score, which ranges from 6 to 1 with: 6) very good; 5) good; 4) fair; 3) moderate; 2) low; 1) very low. The IDC score is available on a yearly basis between 1985 and 2015 and supports a proper interpretation of the WSF evolution product.\n\nThe WSF evolution and IDC score datasets are organized in 5138 GeoTIFF files (EPSG4326 projection) each one referring to a portion of 2 x 2 degree size (~222 x 222 km) on the ground. WSF evolution values range between 1985 and 2015 corresponding to the estimated year of settlement detection, whereas 0 is no data. A comprehensive publication with all technical details and accuracy figures is currently being finalized. For the time being, please refer to Marconcini et al,. 2021.",
"spatial": {
"scale": "global"
},
"license": "CC-BY-4.0",
"contact_point": {
"name": "WSF team",
"email": "wsf@dlr.de",
"url": "https://geoservice.dlr.de/web/datasets/wsf_2019"
},
"creator": {
"name": "Mattia Marconcini"
},
"exposure": {
"category": "buildings",
"metrics": [
{
"id": "1",
"dimension": "structure",
"quantity_kind": "area"
}
]
},
"attributions": [
{
"id": "0",
"entity": {
"name": "Mattia Marconcini",
"email": "mattia.marconcini@dlr.de"
},
"role": "author"
},
{
"id": "1",
"entity": {
"name": "EOC Geoservice",
"email": "geoservice@dlr.de",
"url": "https://geoservice.dlr.de/web/contact"
},
"role": "resource_provider"
},
{
"id": "2",
"entity": {
"name": "WSF team",
"email": "wsf@dlr.de"
},
"role": "processor"
}
],
"referenced_by": [
{
"id": "0",
"name": "Understanding Current Trends in Global Urbanisation - The World Settlement Footprint Suite",
"author_names": [
"Mattia Marconcini",
"Annekatrin Metz-Marconcini",
"Thomas Esch",
"Noel Gorelick"
],
"date_published": "2021-01-01",
"url": "https://austriaca.at/0xc1aa5576%200x003c9b4c.pdf",
"doi": "10.1553/giscience2021_01_s33"
}
],
"resources": [
{
"id": "0",
"title": "World Settlement Footprint (WSF) Evolution 1985-2015",
"description": "Binary mask at 10m resolution outlining the extent of human settlements globally derived by means of 2019 multitemporal Sentinel-1 (S1) and Sentinel-2 (S2) imagery. ",
"format": "geotiff",
"spatial_resolution": 30,
"coordinate_system": "EPSG:4326",
"access_url": "https://geoservice.dlr.de/web/maps/eoc:wsfevolution",
"download_url": "https://download.geoservice.dlr.de/WSF_EVO/",
"temporal": {
"start": "1985",
"end": "2015",
"duration": "P30Y"
},
"temporal_resolution": "P1Y"
}
],
"links": [
{
"href": "https://docs.riskdatalibrary.org/en/0__2__0/rdls_schema.json",
"rel": "describedby"
}
]
}
]
}
Loading

0 comments on commit a349316

Please sign in to comment.