v0.0.8

Enhancements

• Added dlt append_flow api support: #58
• Added dlt append_flow api support for silver layer: #63
• Added support for file metadata columns for autoloader: #56
• Added support for Bring your own custom transformation: #68
• Added support to Unify PyPI releases with GitHub OIDC: #62
• Added demo for append_flow and file_metadata options: #74
• Added Demo for silver fanout architecture: #83
• Added documentation in docs site for new features: #64
• Added unit tests to showcase silver layer fanout examples: #67

Bug fixes

• Fixed issue for No such file or directory: '/demo' :#59
• Fixed issue DLT-META CLI onboard command issue for Azure: databricks.sdk.errors.platform.ResourceAlreadyExists :#51
• Fixed issue Changed dbfs.create to mkdirs for CLI: #53
• Fixed issue DLT-META CLI should use pypi lib instead of whl : #79

Full Changelog: v0.0.7...v0.0.8

v0.0.7

Enhancement

1. Mismatched Keys: Update read_dlt_delta() with key "source_database" instead of "database" #33

2. Create dlt-meta cli documentation #45

• Readme and docs to include above features

v0.0.6

Enhancement

1. Migrate to create_streaming_table api from create_streaming_live_table #37

Updates

• Readme and docs to include above features
• Added Data Quality support for silver layer
• Updated existing demos to incorporate unity catalog and integration test framework
• integration tests framework which can be used to launch demos

Unity Catalog and Databricks labs CLI support

New Features

1. Unity Catalog Support (#28)

2. Databricks Labs CLI Support (#28)

• Added two commands for DLT-META
• onboard: Captures all onboarding details from command line and launch onboarding job to your databricks workspace
• deploy: Captures all DLT pipeline details from command line and launch DLT pipeline to your databricks workspace

Updates

• Readme and docs to include above features
• Updated existing demos to incorporate unity catalog and integration test framework
• integration tests framework which can be used to launch demos

Bug Fixes

Bug Fixes

• Introduced new source detail option for eventhub: eventhub.accessKeySecretName

v0.0.3

Bug Fixes

• Infer datatypes from sequence_by to __START_AT, __END_AT for apply changes API

• Removed Git release tag from github actions

v0.0.2

v0.0.2

New Features

• Table properties support for bronze, quarantine and silver tables using create_streaming_live_table api call
• Support for track history column using apply_changes api
• Support for delta as source
• Validation for bronze/silver onboarding

Bug Fixes

• Input schema parsing issue in onboarding

Updates

• Readme and docs to include above features

Release v.0.0.1

v0.0.1

Removed pypi test from readme