An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
-
Updated
Nov 25, 2024 - Python
#
astronomer
Here are 19 public repositories matching this topic...
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
-
Updated
Aug 21, 2023 - Python
An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.
-
Updated
Jun 30, 2024 - Python
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
mysql python bigquery data-science airflow sql database etl orchestration-framework python3 data-engineering dbt data-modeling extract-transform-load astronomer
-
Updated
Dec 22, 2024 - Python
Reference implementations for orchestration project using Astronomer/Airflow
-
Updated
Dec 2, 2024 - Python
An example project of how to use local devcontainers with the Astronomer Astro platform
-
Updated
May 27, 2024 - Python
Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.
-
Updated
Nov 4, 2024 - Python
Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline
python nlp flask airflow sentiment-analysis tensorflow s3-bucket selenium-webdriver astronomer distilbert huggingface-transformer web-scraping-python
-
Updated
Dec 26, 2024 - Jupyter Notebook
WeatherFlow ETL is an automated pipeline that extracts weather data from public APIs, transforms it by cleaning and standardizing the information, and loads it into a PostgreSQL database for analysis.
-
Updated
Dec 16, 2024 - Python
Airflow DAGs project with DBT hosted by Astronomer.
-
Updated
Dec 26, 2023 - Python
Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)
-
Updated
Mar 26, 2024 - Python
This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.
-
Updated
Jun 28, 2024 - Python
This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing
-
Updated
Mar 16, 2024 - Python
Setting up the dev environment with the Docker compose , Astro and Airflow
-
Updated
Nov 20, 2023 - Python
Hello, Astronomer! - The Enterprise Framework for Apache Airflow
-
Updated
Apr 14, 2021 - Python
astro plugin for asdf version manager
-
Updated
Sep 24, 2024 - Shell
playing around MLOps tools
-
Updated
Dec 26, 2024 - Jupyter Notebook
Repo for Datafest Datathon 2024
-
Updated
Nov 3, 2024 - Python
Improve this page
Add a description, image, and links to the astronomer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the astronomer topic, visit your repo's landing page and select "manage topics."