Skip to content

dbt-spark 0.17.0
Compare
Choose a tag to compare
@jtcohen6 jtcohen6 released this 10 Jun 22:40
v0.17.0
21ea42d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

This is a minor release that tracks dbt==0.17.0.

Breaking Changes

  • Always schema, never database. The plugin disallows setting database properties in node configs or target profiles. All values of database are None. In Apache Spark, relational object namespaces have only two components: the object identifier and the database/schema (used interchangeably) in which it is situated. The plugin exclusively uses the schema property to control the behavior related to the database/schema of Spark objects. (#83, #92)

Features

  • Add support for dbt snapshot (Delta Lake only) (#76)

Fixes

  • The auto-generated docs site (#92):
    • Links the data catalog (information gleaned from the database) to the manifest of models, sources, seeds, and snapshots.
    • Includes metadata about object owner and table size (if available). The groundwork of this feature was originally included in the 0.15.3 release; this information is now visible in the docs site.

Quality of life

  • Prettify the README (#82)
  • Improved error if running on an older, unsupported Spark version (#87)

Contributors

Assets 2
Loading