- KafkaCongestionStreaming
1.1. [API 호출 -> pydantic -> kafka] - SparkCOngestionStreaming
2.1. [Kafka -> [sink-connection -> s3 -> athena], [backend(fastapi)]] - TrafficBackend [backend]
-
KafkaCongestionStreaming
python async_congestion.py
-
SparkCOngestionStreaming
python spark_connection/rate_congestion.py
-
TrafficBackend
sudo docker compose up --build