-
Notifications
You must be signed in to change notification settings - Fork 0
Developed a batch ETL pipeline to extract, transform, and load transactional data from RDS to Redshift. Used Sqoop to ingest data from RDS to HDFS, PySpark to transform and load data to S3, and Redshift to create and query dimension & fact tables. Performed analytical queries to identify ATMs with inactive transactions, ATM failures by weather, etc
urvashiforreal/ETL-Project
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
About
Developed a batch ETL pipeline to extract, transform, and load transactional data from RDS to Redshift. Used Sqoop to ingest data from RDS to HDFS, PySpark to transform and load data to S3, and Redshift to create and query dimension & fact tables. Performed analytical queries to identify ATMs with inactive transactions, ATM failures by weather, etc
Topics
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published