Skip to content

πŸ“€ A Docker Compose stack based on Debezium to create a CDC infrastructure

Notifications You must be signed in to change notification settings

JeanPoffo/debezium-docker-example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

3 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Project logo

Debezium Docker Example

Status Status GitHub Issues GitHub Pull Requests


πŸ“€ A Docker Compose stack based on Debezium to create a CDC infrastructure

πŸ“ Table of Contents

🧐 About

A docker compose stack to create a CDC (Change Data Capture) infrastructure. Is based on Debezium plugin, replicating a Postgres base to Elasticsearch server.

πŸ’­ How it works

Project Diagram

🎈 Usage

Some useful links to query the data processing:

Kibana

http://localhost:5601

PgAdmin

http://localhost:16543

Elastic Data

http://localhost:9200/musics/_search?pretty=true

Connectors

http://localhost:8083/connectors

Connectors Status

http://localhost:8083/connectors?expand=status

Connectors Info

http://localhost:8083/connectors?expand=info

🏁 Getting Started

Just clone and execute this steps:

Initialize Docker

docker-compose up --detach --build --force-recreate

Crete ElasticSearch Index and Apache Kafka Conectors

sh setup.sh

Prerequisites

Docker Compose 1.29.2
Docker 20.10.10

⛏️ Built Using

  • Debezium - Open source distributed platform for change data capture.
  • Apache Kafka - Open source distributed event streaming platform.
  • Apache ZooKeeper - Centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.
  • ElasticSearch - A search engine based on the Apache Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents.
  • PostgreSQL - Open source object-relational database system.

✍️ Authors

About

πŸ“€ A Docker Compose stack based on Debezium to create a CDC infrastructure

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published