From 7da07b4c54c2441d8ed93a3888b47270d559fd6b Mon Sep 17 00:00:00 2001 From: ndp-opendap Date: Sun, 2 Jan 2022 10:29:30 -0500 Subject: [PATCH] olfs: Updating olfs version and release files to version 1.18.10 --- ChangeLog | 286 ++++++++++++++++++++++++++ NEWS | 76 +++++++ README.md | 16 +- resources/hyrax/WEB-INF/conf/olfs.xml | 9 +- 4 files changed, 377 insertions(+), 10 deletions(-) diff --git a/ChangeLog b/ChangeLog index a8494c84c..16813ec07 100644 --- a/ChangeLog +++ b/ChangeLog @@ -1,3 +1,289 @@ +2021-12-30 The-Robot-Travis + + bes-3.20.10-0 2021-12-30T20:42:12+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-125 2021-12-30T16:58:03+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-124 2021-12-30T13:22:33+0000 - Triggering OLFS build + for snapshots. + +2021-12-29 ndp-opendap + + Merge branch 'master' of https://github.com/opendap/olfs + + Dropped link to the (no longer supported) old data request form + +2021-12-27 The-Robot-Travis + + bes-3.20.9-113 2021-12-27T19:51:47+0000 - Triggering OLFS build + for snapshots. + +2021-12-21 The-Robot-Travis + + bes-3.20.9-108 2021-12-21T21:59:20+0000 - Triggering OLFS build + for snapshots. + +2021-12-21 ndp-opendap + + Updated gradle.build for new SLF4J and Logback + +2021-12-21 Nathan Potter + + Updating slf4j and logback libs (#135) + * Updating slf4j and logback libs + * Updating SLF4J and Logback loib refs in alternate build files + * Updated scrubbydubby + * Code Formatting + * Code formatting + * Dropping older Logback and SLF4J libs + +2021-12-20 The-Robot-Travis + + bes-3.20.9-106 2021-12-21T03:01:16+0000 - Triggering OLFS build + for snapshots. + +2021-12-17 The-Robot-Travis + + bes-3.20.9-105 2021-12-18T00:07:36+0000 - Triggering OLFS build + for snapshots. + +2021-12-17 Nathan Potter + + Cleaning urlrewrite config and logging comments to reflect + current implementaion (#134) + + Scrub client User-Agent string + Added Scrub step to client submitted User-Agent string prior to + logging + +2021-12-10 The-Robot-Travis + + bes-3.20.9-103 2021-12-10T05:55:34+0000 - Triggering OLFS build + for snapshots. + +2021-12-09 The-Robot-Travis + + bes-3.20.9-99 2021-12-10T01:49:18+0000 - Triggering OLFS build + for snapshots. + +2021-12-08 The-Robot-Travis + + bes-3.20.9-98 2021-12-09T02:54:47+0000 - Triggering OLFS build + for snapshots. + +2021-12-01 The-Robot-Travis + + bes-3.20.9-91 2021-12-02T02:46:59+0000 - Triggering OLFS build + for snapshots. + +2021-11-30 The-Robot-Travis + + bes-3.20.9-90 2021-11-30T18:11:10+0000 - Triggering OLFS build + for snapshots. + +2021-11-24 The-Robot-Travis + + bes-3.20.9-89 2021-11-24T07:49:14+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-87 2021-11-24T05:59:42+0000 - Triggering OLFS build + for snapshots. + +2021-11-23 The-Robot-Travis + + bes-3.20.9-86 2021-11-24T00:45:45+0000 - Triggering OLFS build + for snapshots. + +2021-11-17 The-Robot-Travis + + bes-3.20.9-76 2021-11-18T01:49:59+0000 - Triggering OLFS build + for snapshots. + +2021-11-16 The-Robot-Travis + + bes-3.20.9-74 2021-11-16T20:45:19+0000 - Triggering OLFS build + for snapshots. + +2021-11-15 The-Robot-Travis + + bes-3.20.9-73 2021-11-15T23:37:37+0000 - Triggering OLFS build + for snapshots. + +2021-11-10 The-Robot-Travis + + bes-3.20.9-68 2021-11-10T19:21:32+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-66 2021-11-10T07:15:33+0000 - Triggering OLFS build + for snapshots. + +2021-11-08 The-Robot-Travis + + bes-3.20.9-61 2021-11-09T03:43:18+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-59 2021-11-09T00:20:04+0000 - Triggering OLFS build + for snapshots. + +2021-11-04 The-Robot-Travis + + bes-3.20.9-58 2021-11-05T00:26:51+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-56 2021-11-04T22:00:14+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-55 2021-11-04T16:51:23+0000 - Triggering OLFS build + for snapshots. + +2021-11-03 The-Robot-Travis + + bes-3.20.9-53 2021-11-03T23:09:23+0000 - Triggering OLFS build + for snapshots. + +2021-11-03 ndp-opendap + + Oops. Adding new gson-2.8.9.jar file now + + Merge branch 'master' of https://github.com/opendap/olfs + + Upgraded gson-2.3.1 to gson-2.8.9 + +2021-11-03 The-Robot-Travis + + bes-3.20.9-52 2021-11-03T19:44:54+0000 - Triggering OLFS build + for snapshots. + +2021-11-02 Nathan Potter + + Patch for bug in BES.trimPrefix() where the passed string was + not (#133) + checked to see if it actually began with the prefix + +2021-11-02 ndp-opendap + + Merge branch 'master' of https://github.com/opendap/olfs + +2021-11-01 The-Robot-Travis + + bes-3.20.9-45 2021-11-02T00:47:26+0000 - Triggering OLFS build + for snapshots. + +2021-11-01 ndp-opendap + + Cleaning up code and normalizing (some) member variable names. + +2021-10-29 The-Robot-Travis + + bes-3.20.9-40 2021-10-29T22:16:33+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-38 2021-10-29T21:06:50+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-36 2021-10-29T17:11:02+0000 - Triggering OLFS build + for snapshots. + +2021-10-28 The-Robot-Travis + + bes-3.20.9-32 2021-10-28T23:18:22+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-29 2021-10-28T19:24:01+0000 - Triggering OLFS build + for snapshots. + +2021-10-27 The-Robot-Travis + + bes-3.20.9-28 2021-10-28T01:03:37+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-27 2021-10-27T20:42:17+0000 - Triggering OLFS build + for snapshots. + +2021-10-22 Nathan Potter + + HTTPS always for the data request form URL (#130) + * First draft of forcing the datarequest fomr URL to https + * Updated default olfs.xml and ngap/olfs.xml with + ForceDataRequestFormLinkToHttps elements + +2021-10-22 ndp-opendap + + Merge branch 'master' of https://github.com/opendap/olfs + + Fixed incorrect redirect URL construction in FileAccess + +2021-10-21 The-Robot-Travis + + bes-3.20.9-20 2021-10-22T01:30:59+0000 - Triggering OLFS build + for snapshots. + +2021-10-21 Nathan Potter + + First pass at dataset_url management via redirects. (#129) + * First pass at dataset_url management via redirects. + * Updated olfs.xml cpmments and the ngap version of same + * More documentation work. + * More documentation work. + * More documentation work. + +2021-10-18 The-Robot-Travis + + bes-3.20.9-15 2021-10-19T00:07:15+0000 - Triggering OLFS build + for snapshots. + +2021-10-15 The-Robot-Travis + + bes-3.20.9-11 2021-10-16T00:46:14+0000 - Triggering OLFS build + for snapshots. + +2021-10-14 The-Robot-Travis + + bes-3.20.9-8 2021-10-14T16:58:22+0000 - Triggering OLFS build + for snapshots. + +2021-09-23 The-Robot-Travis + + bes-3.20.9-6 2021-09-23T19:51:52+0000 - Triggering OLFS build + for snapshots. + +2021-09-23 dh-opendap + + Updated to Version 1.18.9 + +2021-09-21 The-Robot-Travis + + bes-3.20.9-5 2021-09-21T17:07:01+0000 - Triggering OLFS build + for snapshots. + + bes-3.20.9-4 2021-09-21T15:50:41+0000 - Triggering OLFS build + for snapshots. + +2021-09-20 The-Robot-Travis + + bes-3.20.9-3 2021-09-20T19:38:32+0000 - Triggering OLFS build + for snapshots. + +2021-09-17 The-Robot-Travis + + bes-3.20.9-2 2021-09-17T21:22:59+0000 - Triggering OLFS build + for snapshots. + +2021-09-16 The-Robot-Travis + + bes-3.20.8-304 2021-09-16T21:14:51+0000 - Triggering OLFS build + for snapshots. + +2021-09-15 The-Robot-Travis + + bes-3.20.8-303 2021-09-16T00:05:19+0000 - Triggering OLFS build + for snapshots. + +2021-09-15 dh-opendap + + Updated on 2021-09-15 2021-09-02 The-Robot-Travis bes-3.20.8-301 2021-09-02T22:39:38+0000 - Triggering OLFS build for snapshots. diff --git a/NEWS b/NEWS index 4eaad60ac..f93585f2c 100644 --- a/NEWS +++ b/NEWS @@ -1,3 +1,79 @@ +# OLFS Version 1.18.10 (04 January 2022) + +## Configuration and behavior updates. +In order to make the server's behavior more understandable to users, and its configuration +more understandable to admins we have changed the way that the server responds to client +requests for the unadorned Dataset URL and the way that the server generates Data Request +Form links in its catalog pages. There are new configuration parameters to control these +behaviors. + +### +This configuration parameter has been DEPRECATED - Use the and + elements to configure this behavior (see below). + +### +The DatasetUrlResponse element is used to configure the type of response +that the server will generate when a client attempts to access the Dataset URL. +The type of response is controlled by the value of the type attribute. + +Allowed Values: +* dsr - The dap4 DSR response will be returned for the dataset URL. Note: This +setting is not compatible with DataRequestForm type of "dap2" as the DSR response +URL collides with the DAP2 Data Request Form URL. +* download - If the configuration parameter AllowDirectDataSourceAccess is set +(present) thenthe source data file will be returned for the dataset URL. If the +configuration parameter AllowDirectDataSourceAccess is not present then a 403 +forbidden will be returned for the dataset URL. (This is basically a file retrieval +service, any constraint expression submitted with the unadorned dataset URL will be +ignored.) +* requestForm - The Hyrax Data Request Form Page will be returned for the dataset URL. + +Default: download + + +### +The DataRequestForm element defines the target DAP data model for the dataset links +in the "blue-bar" catalog.html pages. These links point to the DAP Data Request Form +for each dataset. This element also determines the type of Data request form page +returned when the DatasetUrlResponse type="requestForm" and the request is for the +Dataset URL. Allowed type values are: dap2 and dap4. + +Default: dap4 + + +### +When enabled users will be able to use Hyrax as a file server and download +the underlying data files/granules/objects directly, without utilizing the DAP APIs. + +Default: disabled. + + +### +The presence of this element will cause the Data Request Form interfaces to +"force" the dataset URL to HTTPS. This is useful for situations where the sever +is sitting behind a connection management tool (like AWS CloudFront) whose outward +facing connections are HTTPS but Hyrax is not using HTTPS. Thus the internal URLs +being received by Hyrax are on HTTP. When these URLs are exposed via the Data +Request Forms they can cause some client's to have issues with session dropping +because the protocols are not consistent. + +Default: disabled + + +## Dependency Library Updates +* Updated the dependency libraries as follows: + - Upgraded gson-2.3.1 to gson-2.8.9 + - Upgraded slf4j-1.7.16 to slf4j-1.7.32 + - Upgraded logback-core-1.1.11 to logback-core-1.2.9 + - Upgraded logback-classic-1.2.0 to logback-classic-1.2.9 + +## Log Sanitization +* Log entries for User-Agent, URL path, and query string are now scrubbed. + +## DAP2 Data Request Form +* Dropped link to in DAP2 Data Request Form to the no longer supported BES +generated request form. + # OLFS Version 1.18.9 (15 September 2021) ## NASA/NGAP Updates diff --git a/README.md b/README.md index 3e0ac405a..44c596c38 100644 --- a/README.md +++ b/README.md @@ -4,17 +4,19 @@ # Hyrax/OLFS -**_Hyrax Version 1.16.4 (17 September 2021)_** +**_Hyrax Version 1.16.5 (04 January 2022)_** + +**_OLFS Version 1.18.10 (04 January 2022 2021)_** + + +### OLFS-1.18.10 requires +* **bes-3.20.10** [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5810850.svg)](https://doi.org/10.5281/zenodo.5810850) +* **libdap4-3.20.9** [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5807905.svg)](https://doi.org/10.5281/zenodo.5807905) + -**_OLFS Version 1.18.9 (17 September 2021)_** -### OLFS-1.18.9 requires -* **bes-3.20.9** [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5524972.svg)](https://doi.org/10.5281/zenodo.5524972) -* **libdap4-3.20.8** [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.5514131.svg)](https://doi.org/10.5281/zenodo.5514131) - - _The files `install.html` and/or `docs/index.html` may have additional information._ ### First: diff --git a/resources/hyrax/WEB-INF/conf/olfs.xml b/resources/hyrax/WEB-INF/conf/olfs.xml index d644763ff..da36b806f 100644 --- a/resources/hyrax/WEB-INF/conf/olfs.xml +++ b/resources/hyrax/WEB-INF/conf/olfs.xml @@ -94,8 +94,9 @@ - @@ -110,7 +111,9 @@ Allowed Values dsr: - The dap4 DSR response will be returned for the dataset URL. + The dap4 DSR response will be returned for the dataset URL. Note: This + setting is not compatible with DataRequestForm type of "dap2" as the + DSR response URL collides with the DAP2 Data Request Form URL. download: If the configuration parameter AllowDirectDataSourceAccess is set (present) then