data_specs/SRTM_DEM_specs.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "f027032b-53eb-43e6-9092-5745a1052546",
   "metadata": {},
   "source": [
    "# Shuttle Radar Topography Mission (SRTM) 1 Arc-Second Global Digital Elevation Model and DEM Derivatives"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "623b1e88-a52d-449f-b7ab-a308634aad0e",
   "metadata": {},
   "source": [
    "## Product overview"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a9caf3ae-a9e7-425b-88d8-530f3cf846eb",
   "metadata": {},
   "source": [
    "### Background"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7a980677-26a8-4054-a4b2-74f437302b3a",
   "metadata": {},
   "source": [
    "The NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) Shuttle Radar Topography Mission (SRTM) global 1 arc second (~30 metre) DEM is archived and distributed by the Land Processes Distributed Active Archive Center (LP DAAC). \n",
    "This dataset is a result of a collaborative effort by the National Aeronautics and Space Administration (NASA) and the National Geospatial-Intelligence Agency (NGA – previously known as the National Imagery and Mapping Agency, or NIMA), as well as the participation of the German and Italian space agencies. \n",
    "The primary goal of creating this dataset was to eliminate voids that were present in earlier versions of the SRTM elevation data. \n",
    "\n",
    "Digital Earth Africa provides free and open access to a copy of the NASA Version 3 SRTM DEM product over Africa. "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "949d1255-8df2-4d18-a7eb-716431fd5194",
   "metadata": {},
   "source": [
    "Digital Earth Africa also provides free and open access to the SRTM DEM Derivatives product over Africa. \n",
    "These derivatives include slope, multi-resolution valley bottom flatness and multi-resolution ridge top flatness. \n",
    "This product was generated by Digital Earth Africa from the Shuttle Radar Topography Mission (SRTM) v3.0 1 arc-second Digital Elevation Model.\n",
    "\n",
    "A [Jupyter Notebook](https://github.com/digitalearthafrica/deafrica-sandbox-notebooks/blob/main/Datasets/Digital_Elevation_Models.ipynb) which demonstrates loading and using DEM datasets in the Sandbox is also available."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1625cae9-0cae-4138-b431-9bec9fc6717d",
   "metadata": {},
   "source": [
    "### Specifications"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b6b798f5-a4b4-403f-8d43-6ba2dd0f221d",
   "metadata": {},
   "source": [
    "#### Spatial and temporal coverage"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "07233424-1cbf-4591-9ad9-831ee90129c2",
   "metadata": {},
   "source": [
    "Relevant metadata for the SRTM DEM and the SRTM DEM derivatives products can be viewed on the DE Africa Metadata Explorer [here](https://explorer.digitalearth.africa/products/dem_srtm) and [here](https://explorer.digitalearth.africa/products/dem_srtm_deriv)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4f710059-83f8-48d0-8e3e-e2f4aa43441a",
   "metadata": {},
   "source": [
    "**Table 1: SRTM DEM and SRTM DEM Derivatives product specifications**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "715d5963-e9bf-4a6e-98e5-eca3ddf271ad",
   "metadata": {},
   "source": [
    "|**Specification**|   |        |\n",
    "|----------|----------|-------------|\n",
    "| Product name | `dem_srtm` | `dem_srtm_deriv` |\n",
    "|Cell size - X  |  0.000278° (~30 m) | 30 m |\n",
    "|Cell size - Y  | 0.000278° (~30 m) | 30 m |\n",
    "|Coordinate reference system | EPSG:4326 | EPSG:6933 |\n",
    "|Temporal Resolution | Multi-Day | Multi-Day |\n",
    "|Temporal Extent | 2000-02-11 to 2000-02-21 | 2000-02-11 to 2000-02-21 |\n",
    "|Update frequency| None | None |"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0ab50612-09f8-4fd5-a68d-96cfc58e302e",
   "metadata": {},
   "source": [
    "The specific temporal and geographic extents for the products can be explored as an interactive map on the Metadata Explorer [here](https://explorer.digitalearth.africa/products/dem_srtm) and [here](https://explorer.digitalearth.africa/products/dem_srtm_deriv). Data is available for the regions shaded in blue."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a1595eca-d8c7-4869-b20f-aa54e1c60881",
   "metadata": {},
   "source": [
    "**Figure 1: SRTM DEM geographic extent**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "150106bf-9908-4946-8b79-990b69536608",
   "metadata": {},
   "source": [
    "<img src=\"../_static/data_specs/SRTM_DEM_specs/srtm-dem-geographic-extent.png\" alt=\"SRTM DEM Geographic Extent\" width=\"300\" align=\"left\"/>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "02d02a92-c4e9-40ab-8348-bd23842d7094",
   "metadata": {},
   "source": [
    "**Figure 2: SRTM DEM Derivatives geographic extent**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "07b2d9b0-d349-4458-ab08-34d429147dea",
   "metadata": {},
   "source": [
    "<img src=\"../_static/data_specs/SRTM_DEM_specs/srtm-dem-derivatives-geographic-extent.png\" alt=\"SRTM DEM Derivatives Geographic Extent\" width=\"300\" align=\"left\"/>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "092bee4a-b64f-4687-bdde-75b9c6c1dc11",
   "metadata": {},
   "source": [
    "#### Measurements"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "439c2084-7a8b-4f97-af32-2da757ae92e3",
   "metadata": {},
   "source": [
    "**Table 2: SRTM DEM and SRTM DEM Derivatives product measurements**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6bb02740-e751-4ef8-add1-e0d849881ee2",
   "metadata": {},
   "source": [
    "| Product name  | Band ID | Description | Units | Data type | No data$^\\dagger$ | \n",
    "| :--     | :--     | :--         | :--   | :--       | :--               |\n",
    "| `dem_srtm`     | elevation | Elevation data. | metre | `int16` | `-32768.0`     |\n",
    "| `dem_srtm_deriv`     | mrvbf | **Multi-resolution Valley Bottom Flatness (MrVBF)**: this identifies valley bottoms (areas of deposition). Zero values indicate erosional terrain and values ≥1 and indicate progressively larger areas of deposition. | `1` | `int16` | `-32768.0`     |\n",
    "|                          | mrrtf | **Multi-resolution Ridge Top Flatness (MrRTF)**: complementary to MrVBF, zero values indicate areas that are steep or low, and values ≥1 indicate progressively larger areas of high flat land. | `1` | `int16` | `-32768.0`     |\n",
    "|                          | slope | **Slope (percent)**: this is the rate of elevation change. | `1` | `float32` | `-9999.0`     |"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4d2eb78f-3543-4b52-aa75-e683d9302812",
   "metadata": {},
   "source": [
    "$^\\dagger$ No data or fill value."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "30d418d2-9a4c-4633-8722-b9ab519d6c83",
   "metadata": {},
   "source": [
    "### Processing"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "888f68ab-bf19-4dfd-ba89-2f9c09e88f19",
   "metadata": {},
   "source": [
    "The NASA Version 3.0 SRTM DEM is a void filled dataset. \n",
    "The missing data in the National Geospatial-Intelligence Agency (NGA) Version 2.0 SRTM DEM was filled using topographic data from non-SRTM sources. \n",
    "The primary fill elevation data was from the Terra Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) Global Digital Elevation Model Version 2.0 (GDEM2) and the secondary fill elevation data from the USGS Global Multi-resolution Terrain Elevation Data (GMTED2010) elevation model or the USGS National Elevation Dataset (NED).\n",
    "The SRTM Version 3.0 processing steps are detailed in [The Shuttle Radar Topography Mission (SRTM) Collection\n",
    "User Guide](https://lpdaac.usgs.gov/documents/179/SRTM_User_Guide_V3.pdf)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f1ce9b20-eac9-4549-8574-239fe118b181",
   "metadata": {},
   "source": [
    "The SRTM DEM Derivatives were generated by Digital Earth Africa from the SRTM v3.0 Digital Elevation Model using [gdaldem](https://gdal.org/programs/gdaldem.html) for the percent slope and [SAGA GIS tool (Version: 2.3.1)](https://saga-gis.sourceforge.io/saga_tool_doc/2.3.0/ta_morphometry_8.html) for the  multi-resolution valley bottom flatness (MrVBF) and multi-resolution ridge top flatness (MrRTF). \n",
    "The scripts used to generate the derivatives are available [here](https://github.com/digitalearthafrica/dem-derivative)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9deec135-2d6d-4995-8ab4-34c139b13581",
   "metadata": {},
   "source": [
    "### Media and example images"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "719e774d-dda5-4aae-a008-83a7596100bd",
   "metadata": {},
   "source": [
    "**Figure 3: SRTM DEM elevation data for Mt. Kenya**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6a477e85-949b-404e-b90d-0751be3b9aab",
   "metadata": {},
   "source": [
    "<img src=\"../_static/data_specs/SRTM_DEM_specs/srtm-dem-mt_kenya.png\" alt=\"COP-DEM-GLO-30 Public Mt. Kilimanjaro\" width=\"500\" align=\"left\"/>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3aa8074c-4b37-4b09-8ba3-ebeec438e15c",
   "metadata": {},
   "source": [
    "**Figure 4: SRTM DEM Derivatives for Mt. Kenya**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "64500f8c-f760-4ef3-bdca-b5731e111741",
   "metadata": {},
   "source": [
    "<img src=\"../_static/data_specs/SRTM_DEM_specs/srtm-dem-derivatives-mt_kenya.png\" alt=\"STRM DEM Derivatives Mt. Kenya\" width=\"600\" height=\"300\" align=\"left\"/>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "57f42d94-de20-4e9a-ba99-45a61750c562",
   "metadata": {},
   "source": [
    "### References"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c393668b-85b1-47be-85ce-3dacc16f2467",
   "metadata": {},
   "source": [
    "T. G., Rosen, P. A., Caro, E., Crippen, R., Duren, R., Hensley, S., Kobrick, M., Paller, M., Rodriguez, E., Roth, L., Seal, D., Shaffer, S., Shimada, J., Umland, J., Werner, M., Oskin, M., Burbank, D., & Alsdorf, D. (2007). The Shuttle Radar Topography Mission. In Reviews of Geophysics (Vol. 45, Issue 2). American Geophysical Union (AGU). https://doi.org/10.1029/2005rg000183"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ff5b2e8b-4e5b-443e-85f9-3e65aea5ca2f",
   "metadata": {},
   "source": [
    "[The Shuttle Radar Topography Mission (SRTM) Collection User Guide](https://lpdaac.usgs.gov/documents/179/SRTM_User_Guide_V3.pdf)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "96eaf262-4bba-4697-a92e-041f4e4162e5",
   "metadata": {},
   "source": [
    "[Shuttle Radar Topography Mission (SRTM) Quick Guide](https://lpdaac.usgs.gov/documents/13/SRTM_Quick_Guide.pdf)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fe4d8894-9c52-4761-9479-19c1f97b5616",
   "metadata": {},
   "source": [
    "[LPDAAC Data Catalogue](https://lpdaac.usgs.gov/products/srtmagl1v003/)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7ed9b765-26ec-491b-bcc0-ddb117031054",
   "metadata": {},
   "source": [
    "[DE Africa DEM Derivatives repository](https://github.com/digitalearthafrica/dem-derivative)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "08649c32-f014-4150-b388-51ea16f3cf44",
   "metadata": {},
   "source": [
    "### License and Acknowledgements"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d007b5ec-fbf4-4ad1-894e-da2ce989be36",
   "metadata": {},
   "source": [
    "The SRTM DEM is available under a [CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/) license."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7b3b0ad5-9c7e-41c9-8482-721ccce70e75",
   "metadata": {},
   "source": [
    "The Digital Earth Africa SRTM DEM Derivatives product is provided free of charge, under a [Apache License 2.0](https://github.com/digitalearthafrica/dem-derivative/blob/main/LICENSE) license."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "71c9e4ed-3986-4264-a9b0-494fd3a722ba",
   "metadata": {},
   "source": [
    "## Data Access"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "10ad6b40-e03b-44cd-985c-37d4cc55cfb6",
   "metadata": {},
   "source": [
    "### Amazon web services S3"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ac3e7723-24b9-4a19-ae61-6d024c81a53f",
   "metadata": {},
   "source": [
    "The SRTM DEM and SRTM DEM Derivatives are available in AWS S3. "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "522455ca-57ee-48d4-adb2-901644c6d76f",
   "metadata": {},
   "source": [
    "**Table 3: SRTM DEM and SRTM DEM Derivatives AWS data access details**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "72cd37fd-5620-4c5e-9096-5528f0456c21",
   "metadata": {},
   "source": [
    "|AWS S3 details | | |\n",
    "| :-- | :-- | :-- |\n",
    "|Product | SRTM DEM  | SRTM DEM Derivatives  | \n",
    "|Bucket ARD | `arn:aws:s3:::deafrica-input-datasets`| `arn:aws:s3:::deafrica-input-datasets` |\n",
    "|Region | `af-south-1` | `af-south-1` |"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "eb3095a9-af3f-40f9-863b-6f6532eb2dab",
   "metadata": {},
   "source": [
    "The bucket is in the AWS region `af-south-1` (Cape Town). Additional region specifications can be applied as follows:\n",
    "\n",
    "`aws s3 ls --region=af-south-1 s3://deafrica-input-datasets/`"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cf24d8ac-bceb-4acc-a2de-d04bbd5c2e8d",
   "metadata": {},
   "source": [
    "The SRTM DEM file path is: `strm_dem/dem_srtm`.\n",
    "The SRTM Derivatives file path is: `srtm_dem/dem_srtm_deriv`."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d74581ab-8865-488d-a31f-92b5d4665d1f",
   "metadata": {},
   "source": [
    "### OGC Web Services (OWS)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "97445c06-67fc-4c3f-880f-9a32abab502c",
   "metadata": {},
   "source": [
    "The SRTM DEM and SRTM DEM Derivatives are available through DE Africa's OWS."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fdb005af-d29a-4154-b6c3-137849227909",
   "metadata": {},
   "source": [
    "**Table 5: OWS data access details.**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bec94f29-6ed6-4c49-b5e7-255d02231d90",
   "metadata": {},
   "source": [
    "|OWS details | |\n",
    "|----------|-------------|\n",
    "|Name | `DE Africa Services` |\n",
    "|Web Map Services (WMS) URL | `https://ows.digitalearth.africa/wms?version=1.3.0` |\n",
    "| Web Coverage Service (WCS) URL | `https://ows.digitalearth.africa/wcs?version=2.1.0`|\n",
    "| Layer names | `dem_srtm`, `dem_srtm_deriv` |"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a8034811-972a-442f-a236-48459b8d0061",
   "metadata": {},
   "source": [
    "Digital Earth Africa OWS details can be found at [https://ows.digitalearth.africa/](https://ows.digitalearth.africa/)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "47ed7a83-9f7b-41c1-ae00-2f9789978f07",
   "metadata": {},
   "source": [
    "For instructions on how to connect to OWS, see this [tutorial](../web_services/index.ipynb)."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6423b519-c140-4e1c-8410-84333ba1fc64",
   "metadata": {},
   "source": [
    "### Open Data Cube (ODC)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d1c755bf-bb37-4d28-a750-70efbc6e3bf2",
   "metadata": {},
   "source": [
    "The SRTM DEM and SRTM DEM Derivatives can be accessed through the Digital Earth Africa ODC API, which is available through the [Digital Earth Africa Sandbox](https://sandbox.digitalearth.africa/hub/login).\n",
    "\n",
    "**ODC product names:**  `dem_srtm`, `dem_srtm_deriv`"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "030164f8-fb92-487c-8e54-329925f14f48",
   "metadata": {},
   "source": [
    "Specific bands of data can be called by using either the default names or any of a band's alternative names, as listed in the table below. ODC `Datacube.load` commands without specified bands will load all bands."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e209400f-ab21-474c-856c-3c3882f16726",
   "metadata": {},
   "source": [
    "**Table 6: ODC products dem_srtm and dem_srtm_deriv band names**"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "680b8506-5997-4d9a-bdc1-af3eecd88103",
   "metadata": {},
   "source": [
    "|           Product           | Band name      |    Alternative names | Fill value | \n",
    "|-----------------------------|----------------|--------------|---------------------|\n",
    "| `dem_srtm`   | elevation |       NaN |      `-32768.0` |               \n",
    "| `dem_srtm_deriv`   | mrvbf |       NaN |       `-32768.0` |   \n",
    "|    | mrrtf |       NaN |       `-32768.0` |          \n",
    "|    | slope |       NaN |       `-9999.0` |          "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d93684c2-8613-4e5d-9508-62584e86ad88",
   "metadata": {},
   "source": [
    "## Technical information"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f596b109-df79-480b-a260-4347eb4d4623",
   "metadata": {},
   "source": [
    "The Kinematic Global Positioning System Geodetic field surveying method was used to validate SRTM data.\n",
    "About 70,000 kilometers of survey lines were collected. The data was used to model long-wavelength error sources.\n",
    "In addition, NASA’s JPL deployed corner reflectors during the SRTM mission which were deployed with precisely measured coordinates and served as control points in the SRTM data."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f1f70a7a-b18c-4ecd-93a9-658d6d584539",
   "metadata": {},
   "source": [
    "Known issues in the NASA SRTM are described in the following publication:\n",
    "\n",
    "Rodriguez, E., C. S. Morris, and J. E. Belz (2006), \n",
    "A global assessment of the SRTM performance, Photogramm. Eng. Remote Sens., 72, 249–260. https://doi.org/10.14358/PERS.72.3.249."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}