Skip to content

Flink application to read from Kafka clicks and displays, detect some suspicious/fraudulent activities and output the suspicious events into a file.

Notifications You must be signed in to change notification settings

waelchabir/ads-fraud-detection-Kafka-Flink

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Ads fraud detection using Kafka and Flink


Project goals

The goal of the project is to:

  • Create a Flink application which will read from Kafka clicks and displays queues
  • Detect some suspicious/fraudulent activities
  • Output the suspicious events into a file.

Setting up project

Please get into the docker folder and run the docker-compose file.
To do so, simply execute these lines in the same directory as the docker-compose.yml file:

  • docker-compose rm -f
  • docker-compose up

By running this docker-compose, it will :

  • Create a Kafka cluster with two topics : “clicks” and “displays”
  • Launch a python script which will send events to those two topics and display them in the terminal

This generator simulates few suspicious/fraudulent patterns that you should detect using Flink. There are 3 distincts patterns we want you to find.

About

Flink application to read from Kafka clicks and displays, detect some suspicious/fraudulent activities and output the suspicious events into a file.

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published