Skip to content

Commit

Permalink
#124 bump version
Browse files Browse the repository at this point in the history
  • Loading branch information
FRosner committed Jan 31, 2017
1 parent 32ed018 commit bd019e3
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,15 +13,15 @@ DDQ is a small library for checking constraints on Spark data structures. It can
DDQ is available as a [spark package](http://spark-packages.org/package/FRosner/drunken-data-quality). You can add it to your spark-shell, spark-submit or pyspark using the `--packages` command line option:

```sh
spark-shell --packages FRosner:drunken-data-quality:4.0.0-s_2.10
spark-shell --packages FRosner:drunken-data-quality:4.1.0-s_2.11
```

### Python API

DDQ also comes with a Python API. It is available via the Python Package Index, so you have to install it once using `pip`:

```
pip install pyddq==4.0.0
pip install pyddq==4.1.0
```

### Project Dependency [![Latest Release](https://img.shields.io/github/tag/FRosner/drunken-data-quality.svg?label=JitPack)](https://jitpack.io/#FRosner/drunken-data-quality)
Expand Down Expand Up @@ -150,7 +150,7 @@ assert(constraintResults(uniqueKeyConstraint).isInstanceOf[ConstraintSuccess])
In order to use the Python API, you have to start PySpark with the DDQ jar added. Unfortunately, using the `--packages` way is [not working in Spark < 2.0](https://issues.apache.org/jira/browse/SPARK-5185).

```
pyspark --driver-class-path drunken-data-quality_2.10-x.y.z.jar
pyspark --driver-class-path drunken-data-quality_2.11-x.y.z.jar
```

Then you can create a dummy dataframe and run a few checks.
Expand Down
2 changes: 1 addition & 1 deletion build.sbt
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
organization := "de.frosner"

version := "4.1.0-SNAPSHOT"
version := "4.1.0"

name := "drunken-data-quality"

Expand Down

0 comments on commit bd019e3

Please sign in to comment.