Skip to content
#

redshift-aws

Star

Here are 5 public repositories matching this topic...

Language: All
Filter by language
All 5 Jupyter Notebook 2 Python 2 SQL 1

khushal2405 / Daily-Incremental-load-ETL-pipeline-for-Ecommerce-company-using-AWS-Lambda-and-Apache-airflow

Star 4

Daily Incremental load ETL pipeline for Ecommerce company using AWS Lambda and AWS EMR cluster, Deployed using Apache airflow in a docker container.

docker dockerfile aws postgres lambda aws-lambda docker-compose docker-container aws-s3 lambda-functions postgresql aws-emr aws-ec2 redshift oltp aws-emr-clusters aws-glue redshift-aws glue-jobs lambda-trigger
  • Updated Mar 17, 2023
  • Python

EddieAmaitum / Spar-Nord-Bank-ETL-and-BI-Project

Star 1

In this project I build a batch ETL pipeline to read transactional data from Amazon RDS, transform it to a usable format and then load it into an Amazon S3 bucket. The data is then loaded into Redshift Tables, after which I perform analytical queries on the loaded data to gain insights.

python aws sql big-data hadoop databases pyspark business-intelligence data-analysis mapreduce batch-processing sqoop schema-design redshift-aws rds-mysql
  • Updated Oct 5, 2023
  • Jupyter Notebook

urvashiforreal / ETL-Project

Star 0

Developed a batch ETL pipeline to extract, transform, and load transactional data from RDS to Redshift. Used Sqoop to ingest data from RDS to HDFS, PySpark to transform and load data to S3, and Redshift to create and query dimension & fact tables. Performed analytical queries to identify ATMs with inactive transactions, ATM failures by weather, etc

pyspark sqoop redshift-aws
  • Updated Oct 31, 2023
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the redshift-aws topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the redshift-aws topic, visit your repo's landing page and select "manage topics."

Learn more