Experiment pipeline
TODO
Include it in .travis.yml files for automatic deployment after successful tests.
flow-deploy ...
Using SmartDispatch as a backend
flow-submit [SCHEDULER OPTIONS] [COMMAND] ...
Can be combined with flow-execute
flow-submit [SCHEDULER OPTIONS] flow-execute shub://bouthilx/my-experiment:version [COMMAND] ...
flow-execute shub://bouthilx/my-experiment:version [COMMAND] ...
TODO
In .bashrc or similar,
SINGULARITY_DIR=/some/path/to/singularity
export SREGISTRY_STORAGE=$SINGULARITY_DIR
export SINGULARITY_CACHEDIR=$SINGULARITY_DIR/cache
export SREGISTRY_DATABASE=$SINGULARITY_DIR
export SREGISTRY_NVIDIA_TOKEN=<SECRET>
export DATA_FOLDER=/some/path/to/data
If using mongodb secured with a certificate,
export CERTIFICATE_FOLDER=/some/path/to/certs
TODO