This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (transform). Finally, we load the transformed data to database (load).
Python framework for building Google Cloud Composer workflows.
DEMO: Google Cloud Composer (Airflow v2) SMTP Email Configuration
Add a description, image, and links to the cloud-composer-environment topic page so that developers can more easily learn about it.
To associate your repository with the cloud-composer-environment topic, visit your repo's landing page and select "manage topics."