A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset
-
Updated
Nov 9, 2024 - Dockerfile
#
mage-ai
Here are 29 public repositories matching this topic...
End-to-end data engineering project
-
Updated
Jul 19, 2023 - Jupyter Notebook
An end-to-end data engineering pipeline that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python bigquery data automation cloud sql database docker-compose virtual-machine excel gcp mariadb orchestration data-engineering maintenance database-schema compute-engine work-orders visualization-dashboard mage-ai
-
Updated
Dec 14, 2024 - Jupyter Notebook
Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio
-
Updated
Sep 19, 2023 - Jupyter Notebook
A data engineering project built around Smogon's Stats API.
-
Updated
Nov 21, 2024 - Python
Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.
python docker workflow data-science database etl docker-compose orchestration datascience data-engineering data-analysis etl-pipeline de-zoomcamp mage-ai
-
Updated
Mar 4, 2024 - Jupyter Notebook
Docker image for Mage AI deployment using Docker
-
Updated
Dec 23, 2024 - Dockerfile
-
Updated
Jan 8, 2024 - Python
mlops zoomcamp capstone project
-
Updated
Jun 25, 2024 - Jupyter Notebook
In this project, I demonstrate creating a data pipeline from NYC Taxi data using Mage.ai for ETL, GCP for storage and BigQuery, and Looker Studio for analytics.
-
Updated
Oct 4, 2024
Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.
-
Updated
Oct 5, 2023 - Jupyter Notebook
An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.
-
Updated
Aug 12, 2023 - Jupyter Notebook
Personal project for Data Engineering Zoomcamp
-
Updated
Apr 13, 2024 - Jupyter Notebook
The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.
data-storage data-engineering cloud-computing public-data data-processing data-pipeline amazon-s3 etl-pipeline script-automation mage-ai cnpj-data
-
Updated
Sep 1, 2024 - Python
A quick analysis of Yellow Taxi cabs riding in New York 2022
-
Updated
Jun 11, 2023 - Jupyter Notebook
Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.
bigquery google-cloud-storage data-engineering data-analytics google-cloud-platform etl-pipeline data-modelling gcp-vm looker-studio compute-instance mage-ai
-
Updated
Feb 2, 2024 - Jupyter Notebook
Data Engineering on GCP and Mage AI
google-cloud-storage fact-table big-query sales-analytics dimensional-modeling looker-studio mage-ai
-
Updated
Mar 25, 2024 - Jupyter Notebook
Project MLOps
flask aws streaming monitoring mongodb model grafana orchestration batch-processing prefect mlops mlflow mage-ai
-
Updated
Sep 28, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the mage-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mage-ai topic, visit your repo's landing page and select "manage topics."