Skip to content

Airflow Executor plugin for using DRMAA-compliant HPC systems

Notifications You must be signed in to change notification settings

TIGRLab/drmaa_executor_plugin

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

Repository files navigation

Airflow Plugin - DRMAA

This plugin enables Airflow to use DRMAA-compliant HPC schedulers as an Executor for jobs

Executors

DRMAAV1Executor

Implementation for using drmaa v1 API for interfacing with compliant schedulers

HybridDRMAAExecutor

Allow Airflow scheduler to submit jobs to run jobs locally (LocalExecutor) or on drmaa v1 compliant schedulers

Requirements

Using drmaa_executor_plugin requires the user to set up the drmaa python package.

pip install drmaa
EXPORT DRMAA_LIBRARY_PATH=/path/to/libdrmaa.so.x

About

Airflow Executor plugin for using DRMAA-compliant HPC systems

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published