node_kafka

Real-Time Data Pipeline and Search Client with Kafka, ElasticSearch, Node.js and Angular

Table of Contents (Optional)

• Installation
• Features

---

Installation

• Clone the repository to your local machine
• Install docker-compose

Clone

• Clone this repo to your local machine using git clone https://github.com/MahmoudWael/node_kafka.git

Setup

After installing docker-compose (this will run kafka, zookeeper and nodeJS server)

$ cd node_kafka
$ /bin/bash start.sh 

To run the angular client

$ cd node_kafka/client
$ ng serve

To run the producer and consumer

$   /bin/bash start-producer-consumer.sh 

Swagger docs for endpoints

http://localhost:3000/api-docs

Features

• Collect data from source.
• Consume data to elasticsearch index
• Full-text search on consumed data.
• Angular client to search data.

License

• MIT license