indexing, role-based access, and bulk download fixes

• upgrade dor-services to the latest version (currently 5.8.2) to fix formatting of workflow step completion/error dates in solr docs. this was preventing indexing of most things, since solr rejected the dates as being in an invalid format. see issue #758.
• fix construction of queries for listing APOs and collections to which a user has access. this was preventing role based access from working properly. see issue #759.
• add a .xml extension to the descMD files in MODS bulk download. see issue #756.
• update nokogiri to 1.6.8 (address vulnerability that failed bundle audit).

in the case of the first two bugs, argo and dor-services had been doing the wrong thing for a very long time, but solr had previously been tolerant of our malformed requests (an upgrade to solr 6.1 brought stricter behavior from solr).

modsulator fixes

Set modsulator-app request timeouts, and prevent files from being deleted upon the first modsulator job failure.

bug fixes: purge, bulk job log display

• purge command fixed to delete solr doc when deleting fedora object. tests added.
• prevent 500 error on bulk upload log display page when a particular job has a corrupt/missing log file. tests added.

fix indexing when updating datastreams or adding workflows on objects

fix #725 (by loading objects in ItemsController via Dor.find instead of Dor::Item.find, since ItemsController does not actually deal exclusively with Dor::Items).

Extend Delayed Jobs max runtime

• Extend the maximum runtime of Delayed Jobs to 48 hours instead of 30 minutes (pull request #720)

delayed job monitoring, bulk desc metadata download resilience

• Add Eye for monitoring Delayed Job (issue #712, pull request #641)
• Retry DOR requests when downloading descriptive metadata in bulk (issue #714, pull request #716)

fix retrieval of preserved file content

fix retrieval of file content for versions of items that have made it to preservation. (issue #666, PR #713)

v3.1.0

• Add cursor to entire hierarchical facet li to indicate it is clickable. (PR #695)
• User webauth headers checked against current workgroups in APOs as .htaccess is now deployed every 5 minutes via whenever gem (Issue #683, PR #703)
• In bulk operations, get druids from search now fixed (PR #674)
• Open Version via Bulk Upload no longer produces invalid versionMD (issue #671, PR #704)
• Spreadsheet/MODS upload in stage no longer fails to update objects, no errors logged (Issue #693, PR #704)
• Bulk download can handle many more druids (large queries) (PR #707; at least a partial fix for #652)
• Bulk download resets failure/success counters to report the correct numbers when the job is restarted (partial fix for #652)
• Allow users with APO roles access to the APO itself (issue #76; cancancan PR #706, PR #596)
• upgrade to dor-services v5.7.0
  • default object rights datastream xml gets correct utf-8 encoding (instead of ISO-8859-1 aka LATIN1) (Issue #691)
  • return an empty FileGroupDifference when contentMetadata is missing

v3.0.2

• fix solr link for object detail page
• remove deprecated sdr.url setting
• add the Registration datetime to the report columns
• add checks for which reports are on and off by default
• fix Purge button check (only activate Purge button if object is in registered state)
• upgrade dor-services to v5.6.0 (indexing fixes, descMetadata relatedItem fix)
• refactor Report#pids and add tests that would've caught a regression that turned up in manual testing
• fix another Report method and add tests

v3.0.0-rc.4

• Remove unused workflow_grid.json template
• Changes necessary after spreadsheet_helper was refactored into models/user_log.
• upgrade from dor-services 5.4.2 to dor-services 5.5.2
• Use workflow service instantiated from Dor::Config
• Fixes an issue where prepare bulk update can not be done by adding can_open_version? inside a new class DorObjectWorkflowStatus