Skip to content

Implemented data pipeline for validating email and sending OTP using kafka, mongodb, webhooks and airflow

Notifications You must be signed in to change notification settings

pooja97/kafka-airflow-mongodb

Repository files navigation

Data Pipeline using Apache Kafka, AirFlow, MongoDB, and Docker

Introduction

Implemented a data pipeline using Apache Kafka and MongoDB as a Database for validating email and sending OTP via email and Slack messages using webhooks. Orchestrated the complete process using Apache Airflow through Docker.

Technologies Used: AirFlow
Kafka
MongoDB
Docker
Programming Language:
python3
Slack Webhook

About

Implemented data pipeline for validating email and sending OTP using kafka, mongodb, webhooks and airflow

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published