Popular repositories Loading

1. etl_aws_s3_spark_datalake etl_aws_s3_spark_datalake Public

   ETL pipeline that transforms JSON files from AWS S3 bucket to Parquet files also in S3 bucket

   Python 1

2. data_pipeline_apache_airflow data_pipeline_apache_airflow Public

   Move data from AWS S3 to Redshift using Apache Airflow

   Python 1 1

3. etl_and_data_modeling etl_and_data_modeling Public

   Python-based ETL pipeline that transforms local JSON files into a PostgreSQL database, including data modeling for the flow.

   Jupyter Notebook

4. etl_aws_s3_redshift etl_aws_s3_redshift Public

   ETL pipeline that moves JSON files from AWS S3 to Redshift, including data modeling for the flow.

   Python

5. etl_and_data_modeling_nosql etl_and_data_modeling_nosql Public

   Python-based ETL pipeline that transforms local JSON files into an Apache Cassandra database

   Jupyter Notebook

6. streaming_etl_optimize_public_transportation streaming_etl_optimize_public_transportation Public

   Streaming event pipeline with Apache Kafka and its ecosystem to simulate and display the status of train lines in real time

   Python