kafka producer and consumer example in scala and java

you can test with local server.

start zookeeper

if you have installed zookeeper, start it, or run the command:

bin/zookeeper-server-start.sh config/zookeeper.properties

start kafka with default configuration

> bin/kafka-server-start.sh config/server.properties

create a topic

> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 10 --topic test_topic

package this example

mvn clean package

it will package compiled classes and its dependencies into a jar.

Run the Producer

This example also contains two producers written in Java and in scala. you can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ProducerExample 10000 test_topic localhost:9092

or this for scala

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaProducerExample 10000 test_topic localhost:9092

Run the Consumer

This example contains two consumers written in Java and in scala. You can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ConsumerExample localhost:2181 group1 test_topic 10 0

or this for scala:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaConsumerExample localhost:2181 group1 test_topic 10 0