Skip to content
This repository has been archived by the owner on Mar 31, 2023. It is now read-only.

CLI Improvements and DSpace ingest
Compare
Choose a tag to compare
@hakbailey hakbailey released this 14 May 20:33
· 45 commits to main since this release
v2.0
365c866
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
  • Adds DSpace METS ingest processing
  • Updates Makefile to use AWS CLI v2 commands
  • Removes Aleph-specific update vs. full load detection, and instead handles that outside this codebase (now in mario-powerup) so that all sources can be ingested via the same command patterns
  • Significant CLI changes:
    • Updates cli library from v1 to v2
    • Removes all but url and v4 flags from global options
    • Removes debug flag and instead logs everything of interest by default
    • Adds a boolean new flag to the ingest command that indicates
      whether a new index should be created, and makes ingest default to updating the existing production index for the
      source being ingested
    • Renames type option on ingest to source and remove prefix option, now uses source to determine the prefix
    • Organizes all commands in two groups: ES actions and index actions
    • Adds "required" to all required options
    • Reorganizes ingest options to have index first (to match the other index commands) followed by required options, then optional ones
    • Removes RulesFile option from ingest command, also removes it from the ingester configuration, and instead hard codes the rules file directly in the MARC generator (to match other MARC-specific config file handling)
    • Removes prefix option from the promote command and determines the prefix from the index name within the es Promote function
    • Fixes a bug in the es Promote function that would demote an index if it was already in the timdex-prod alias and it was passed to the promote command
    • Updates README command examples to match the new cli
  • Replaces logging that was removed in a previous refactor, and adds a bit of new logging
Assets 2
Loading