An end-to-end data engineering pipeline that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python bigquery data automation cloud sql database docker-compose virtual-machine excel gcp mariadb orchestration data-engineering maintenance database-schema compute-engine work-orders visualization-dashboard mage-ai
-
Updated
Dec 14, 2024 - Jupyter Notebook