Using Globus to stage files
Follow these steps to stage files using Globus:
- Request a link to a Globus location from the Preassembly home page
- Transfer folders and files into the Globus location
- Make sure your manifest and folders conform to the instructions outlined in Content Staging
If this is your first time using Globus, you will need to be finish setting up a Globus account. Anyone with an active SUNet ID can use Globus, but accounts are not fully set up until the first time you use the services. Follow the instructions provided by Stanford University IT to configure your account.
To create a Globus location
- Go the Preassembly home page
- Click on the button labeled "Request Globus link"
- It will take a few moments to create the link to the Globus location
- Once the link to the location has been created, your browser should open it in a new tab
- Note: You may be prompted to accept pop-up windows from the Preassembly app in order to open the new tab
- Use your Stanford identity to log in
- The Preassembly interface will also update to show the link in the box labeled "staging location"
- You will also receive an email from Globus containing the link to the location
You should now see the following:
- A new tab with the Globus file manager open
- An updated Preassembly home page showing the Globus link URL in the field for the staging location
Please note that Globus locations are temporary and are not permanent storage locations. Globus links are meant to be used only once per accessioning batch.
Globus links will automatically expire on the following schedules:
- If accessioning is completed: one week after the batch was completed successfully
- If the link is never used: four weeks after being created
Please request one link per accessioning batch.
Once a Globus link has been created, your browser will open that link automatically. You may begin to add files to the new location immediately, but you are also free to close the browser tab and return to the link later. Each link is a unique URL that will always return to the same location (until the link expires according to the criteria outlined above).
There are three ways you can transfer files into a Globus location:
- Using the Globus client (known as "Globus Connect Personal")
- Connecting to your Stanford Google Drive account via the browser
- Direct upload via the browser from your local computer
It is generally most reliable to use the Globus client or the Stanford Google Drive connection, especially if transferring files for multiple items. The browser upload option is most suited for smaller amounts of content as it requires you to keep your browser open during the upload process, and it's only possible to upload one file or folder at a time.
The Globus web interface is organized around a side-by-side display of the contents of two separate locations.
Transfers between the two locations can be made in either direction: from the left to the right or the right to the left. When a new Preassembly staging location is first opened, it will appear on the right-hand side of the Globus window. If using the Globus client or Stanford Google Drive to transfer files, you will select one of those locations on the left-hand side of the window.
Note: The email sent from Globus will open the Preassembly location on the left-hand side of the window. You can then choose the location of your data on the right-hand side of the window and transfer files "leftwards". However, these instructions are written assuming the Preassembly location is on the right-hand side, with file transfers going to the right.
Make sure you have the Globus client, known as Globus Connect Personal, installed on your machine. Note that installation requires administrative access to your computer, so you may need assistance from tech support. See the installation instructions from University IT for detailed steps and links to where to download the client. Note that you must enable encryption on your personal "collection" in order to use Globus with Preassembly.
Once the Globus client has been installed on your machine, you will be able to select it using the Globus file manager:
- Navigate to the location on your machine where you've placed your content to be accessioned.
- Select the manifest file(s) and the item folders.
- Click "Start" to copy them into the Globus staging location.
This will begin a transfer of the files using the client installed on your machine. The transfer will run as long as your computer remains connected to the internet, so you do not have to keep the browser window open. If you turn off the computer or disconnect it from the internet, the transfer will pause. It will resume automatically when you reconnect to the internet. Globus will send an email confirmation when the transfer is complete.
- If the file organization looks correct, you are ready to move on to filling out the Preassembly web form.
First, you must connect your Globus account to your Stanford Google Drive account. This service is managed by University IT and only works with your Stanford account, not other Google accounts. Please see the instructions provided by University IT, which include important notes about the limits of the Google Drive service.
Once your Google Drive account is connected, you can access it as a collection in the Globus interface.
Once you've selected your Google Drive location, the steps are similar to those outlined in the section above regarding use of the Globus client:
-
Navigate to the location on your Google Drive where you've placed your content to be accessioned.
-
Select the manifest file(s) and the item folders.
-
Click "Start" to copy them into the Globus staging location.
- You do not need to keep your browser window open or your laptop running while this transfer runs, as it takes place entirely between Google Drive and the Preassembly Globus location. Globus will send an email confirmation when the transfer is complete.
-
Once the file transfer is complete, select the pane with the Preassembly location and then click on "Refresh list" to update the view. Your files should now appear in both panes.
-
If the file organization looks correct, you are ready to move on to filling out the Preassembly web form.
Globus also provides an option to upload files and folders directly through your browser. This option does not require you to configure or select another collection from which to copy your files.
The upload option can be found in the "bar" in the middle of the Globus web interface:
When using this option, you must keep your browser tab open while uploads are in progress, and you will need to upload each item folder individually. Consequently, it is not recommended for batches that contain many items. The Globus client and Google Drive options also provide more levels of protection in terms of data integrity.
If you have not bookmarked your Globus link after it's first created, you can always copy the link from within the Globus interface. To copy the link:
- Go to your Globus location
- Click on the link icon in the middle bar (between the two panes)
- Use the clipboard icon to copy the URL to your clipboard
You will need this link when you fill out the Preassembly web form.
Globus provides some rudimentary file management options, including the ability to move, rename, and delete files or folders. If you determine that you have not arranged your content appropriately after copying it into the Globus location, you may be able to remediate your data without having to re-upload any files.
However, you may find Globus less flexible or responsive than organizing files on your own computer or in Google Drive. As such, it is best to make sure your items already meet the guidelines for organizing content before transferring them to Globus.