Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Reorganize AMAUAT sample data #67

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

ross-spencer
Copy link
Contributor

@ross-spencer ross-spencer commented Nov 6, 2019

Automated acceptance tests use specific transfers within the sample data repository that enable the results of changes in Archivematica to be measured. We also use the sample data to test standard workflows during day to day testing and demonstration. A change to one of these transfers, e.g. the addition of a file, or a change to one, can impact the ability for automated acceptance tests to pass where results are expected to be controlled.

This PR separates the AMAUAT data from the standard sample data by duplicating it where appropriate or moving it. This PR should allow us to more expressively organize the sample data in this repository moving forward, including starting to delete unneeded sample data or improve that which is there.

We create a new top-level AMAUAT folder and store all AMAUAT transfers there. Organized initially by transfer type.

tree -d amauat-automated-acceptance-tests/
amauat-automated-acceptance-tests/
├── bagit
│   ├── BagTransfer
│   │   └── data
│   │       └── bagTest
│   └── UnzippedBag
│       └── data
├── Dataverse
│   └── NDSAStaffingReport
│       └── metadata
└── standard-transfer
    ├── badNames
    │   ├── logs
    │   │   └── fileMeta
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    │       ├── ^
    │       ├── <
    │       ├── >
    │       ├── _
    │       ├── ,
    │       ├── :
    │       ├── !
    │       ├── ?
    │       ├── @
    │       ├── $
    │       ├── *
    │       ├── &
    │       ├── #
    │       ├── %
    │       ├── +
    │       ├── backward\slash
    │       ├── (brackets)
    │       ├── {curlyBrackets}
    │       ├── ends with a space 
    │       ├── period.
    │       ├── 'quote'
    │       ├── "quote"
    │       └──  starts with a space
    ├── broken_package_format_types
    │   ├── gz
    │   ├── rar_1
    │   ├── rar_2
    │   ├── tar
    │   └── zip
    ├── DemoTransferCSV
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    │       └── artwork
    ├── fixityCheckShouldFail
    │   ├── logs
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    ├── manual-normalization
    │   └── manualNormalization
    │       └── preservation
    ├── OfficeDocs
    │   ├── logs
    │   │   └── fileMeta
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    ├── pictures
    ├── pid-binding
    │   ├── hierarchy-with-empty-dir
    │   │   ├── dir1
    │   │   │   └── dir1a
    │   │   │       └── dir1ai
    │   │   └── dir2
    │   │       └── dir2a
    │   │           ├── dir2ai
    │   │           ├── dir2aii
    │   │           └── dir2aiii
    │   └── hierarchy-with-empty-dir-compressed
    ├── preforma
    │   ├── all-conform-policy
    │   ├── all-conform-policy-norm-acc
    │   ├── all-conform-policy-originals
    │   ├── all-valid
    │   ├── manually-normalized-access-all-conform-policy
    │   │   └── manualNormalization
    │   │       └── access
    │   ├── manually-normalized-access-none-conform-policy
    │   │   └── manualNormalization
    │   │       └── access
    │   ├── manually-normalized-preservation-all-conform-policy
    │   │   └── manualNormalization
    │   │       └── preservation
    │   ├── manually-normalized-preservation-none-conform-policy
    │   │   └── manualNormalization
    │   │       └── preservation
    │   ├── none-conform-policy
    │   ├── none-conform-policy-norm-acc
    │   ├── none-conform-policy-originals
    │   ├── none-valid
    │   ├── when-normalized-access-all-valid
    │   ├── when-normalized-all-valid
    │   └── when-normalized-none-valid
    ├── Unicode
    │   ├── logs
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    └── virusTests
        └── metadata

Connected to archivematica/Issues#851
Connected to archivematica/Issues#859

This re-organization requires artefactual-labs/archivematica-acceptance-tests#153 to ensure AMAUAT remain functional.

This test makes it easier to control the changes introduced with #66 where bag transfers are isolated to enable more bag types to be added, e.g. with a processing configuration or DC metadata.

@ross-spencer ross-spencer changed the title WIP: Reorganize AMAUAT sampledata WIP: Reorganize AMAUAT sample data Nov 6, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant