Managed Airflow on Ambari

Setup, configure and monitor Apache Airflow cluster on Ambari

airflow-on-ambari is a simple mpack to install Apache Airflow on Apache Ambari. This mpack is helpful for who uses apache ambari to manage their big data cluster and wants to have apache airflow as their workflow manager.

This mpack allows you to have single node or a cluster of airflow on your ambari cluster. Adding new a new worker node and adding it to cluster is simple as some clicks.

How to install

To install the last version of airflow (v1.10.9), run the following commands on your ambari server.

wget https://github.com/moein7tl/airflow-on-ambari/releases/download/v1.2.0/airflow-on-ambari.tar.gz -P /tmp
ambari-server stop
ambari-server install-mpack --mpack=/tmp/airflow-on-ambari.tar.gz
ambari-server start

After installing mpack, go to Stack and Versions in ambari panel, click on Add service for Airflow and follow the wizard for installation.

Screenshots

Airflow in Stack and Versions

Manage and monitor airflow by ambari

Airflow configurations