OUTLINE.md

In this documentation of the DataStore project you can learn about the following topics:

Some historical perspective

The Brief Intro aka README.md

• HPC DataStore
  • Notes that shall not be overlooked...
  • Technicalities
• Starting the server
  • From command line
  • From IDE
• Public testing server
  • Testing it with BigDataViewer
  • Testing it with Fiji Client
• Start with Importing Own Dataset

Description

• Connection Scheme
• Storage Architecture
  • The BDV Dialect
• Chunks
• Multi-resolution
• Versions of Data
• N5, Zarr and NGFF
• Clients
  • A Minimal Download Macro
  • GUI Enhanced Download Macro

Features

• Server-side Auto Pyramids
• Client-side Auto Pyramids
• Mixing of Versions
• Querying the DataStore Server
• Adding a New Channel to Existing Dataset
• Own Dataset Title and Metadata
• Zarr and NGFF Compatibility

Applications

• A Storage-Independent Image Fileformat
• Gateway to S3 Storage
• BDV, Mastodon and Friends
  • BDV Browses BDS
  • BDV Opens Tailored XML
• HPC Cluster

How-Tos

• Creating from an Existing HDF5/XML
• Converting Between TIFFs and DataStore
• Adding a New Channel
• Viewing DataStore content with BigDataViewer
  • Legacy BigDataServer and BDV
  • DataStore and BDV
• Migrating and/or Duplicating a dataset among multiple DataStore servers
  • Physically copying N5/Zarr files into another DataStore server
  • Notifying the DataStore of a newly added dataset
  • Deleting a dataset from DataStore sever
• Serving one and the same dataset from multiple DataStore servers