The spark-cassandra-connector-embedded
artifact can be used as a test or prototype dependency to spin up embedded servers for testing ideas, quickly learning, integration, etc.
Pulling this dependency in allows you to do
- Integration Tests (IT) tests with an embedded Cassandra instance
- if your sbt project is configured to run IT configs
- Easily write and run a Spark Streaming app using
- Apache Kafka streams (including an embedded Zookeeper), all with no Ops work involved
- Twitter streams (needs the 4 auth credentials required by twitter)
- And of course Cassandra but you currently need to sping up a local instance: Download Cassandra latest, open the tar, and run
sudo ./apache-cassandra-2.1.0/bin/cassandra
Simply add this to your SBT build, or in the appropriate format for a Maven build
"com.datastax.spark" %% "spark-cassandra-connector-embedded" % {latest.verson}