Latest version : 0.4.0

[ronanstokes-db]

The latest version is 0.4.0 and this may be installed in a notebook using pip install dbldatagen

The key updates for this release are the addition of support for constraints and standard datasets.

Standard datasets allow you to create synthetic datasets from pre-defined recipies. As the standard datasets produce a pre-configured data generator instance, you can add columns and constraints to it or use it as is and invoke the build() method to create your dataset.

This allows creation of a synthetic dataset, optionally customized with a specific number of rows and partitions, in as little as 1 line of code.

For example, lets create and view a basic dataset with 1 million rows of user data

import dbldatagen as dg
display(dg.Datasets(spark, "basic/user").get(rows=1000_000).build())