Skip to content

rwurdig/Data-Engineering-Test-Raizen-Analytics

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
 
 
 
 

Repository files navigation

Data Engineering Test - Raízen Analytics

Installation

Table of Contents

Requirements

Tools requires the following to run:

Installation

Clone this repository and go to directory.

git clone https://github.com/rwurdig/Data-Engineering-Test-Raizen-Analytics.git

cd Data-Engineering-Test-Raizen-Analytics/airflow

Initialize the Database.

  • Airflow deploy

docker-compose up airflow-init docker-compose up -d

Outuput
  • airflow-worker

/home/airflow/parquet/sales_diesel.parquet /home/airflow/parquet/sales_oil_derivative_fuels.parquet

After returning this message:

airflow-init_1 | Upgrades done airflow-init_1 | Admin user airflow created airflow-init_1 | 2.3.4 start_airflow-init_1 exited with code 0

Your envoirment was successed building.

The account created has the login airflow and the password airflow.

Accessing the web interface The webserver is available at: http://localhost:8080. The default account has the login airflow and the password airflow.

Running already builded

docker-compose up

Foi feito upload de uma screenshot do Dag sendo executado com sucesso.

  • evidencia teste_Airflow_sucesso.jpg

About

Data Engineering Test - Raizen Analytics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published