-
Notifications
You must be signed in to change notification settings - Fork 226
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* init pr for backport of 418 to 1.0.latest * add changelog entry * add ref to 0.21 in changelog history * expand out ref to past 1.0.0 * remove excess spacing
- Loading branch information
1 parent
38334db
commit 52dacf9
Showing
13 changed files
with
347 additions
and
166 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
## Previous Releases | ||
For information on prior releases of dbt-spark prior to 1.0.0 please see | ||
- [0.21](https://github.com/dbt-labs/dbt-spark/blob/0.21.latest/CHANGELOG.md) | ||
- [0.20](https://github.com/dbt-labs/dbt-spark/blob/0.20.latest/CHANGELOG.md) | ||
- [0.19 and earlier](https://github.com/dbt-labs/dbt-spark/blob/0.19.latest/CHANGELOG.md) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,20 @@ | ||
## dbt-spark 1.0.0 - December 3, 2021 | ||
|
||
### Features | ||
- Add support for Apache Hudi (hudi file format) which supports incremental merge strategies ([#187](https://github.com/dbt-labs/dbt-spark/issues/187), [#210](https://github.com/dbt-labs/dbt-spark/pull/210)) | ||
|
||
### Fixes | ||
- Incremental materialization corrected to respect `full_refresh` config, by using `should_full_refresh()` macro ([#260](https://github.com/dbt-labs/dbt-spark/issues/260), [#262](https://github.com/dbt-labs/dbt-spark/pull/262/)) | ||
|
||
### Under the hood | ||
- Refactor seed macros: remove duplicated code from dbt-core, and provide clearer logging of SQL parameters that differ by connection method ([#249](https://github.com/dbt-labs/dbt-spark/issues/249), [#250](https://github.com/dbt-labs/dbt-snowflake/pull/250)) | ||
- Replace `sample_profiles.yml` with `profile_template.yml`, for use with new `dbt init` ([#247](https://github.com/dbt-labs/dbt-spark/pull/247)) | ||
- Remove official support for python 3.6, which is reaching end of life on December 23, 2021 ([dbt-core#4134](https://github.com/dbt-labs/dbt-core/issues/4134), [#253](https://github.com/dbt-labs/dbt-snowflake/pull/253)) | ||
- Add support for structured logging ([#251](https://github.com/dbt-labs/dbt-spark/pull/251)) | ||
|
||
### Contributors | ||
- [@grindheim](https://github.com/grindheim) ([#262](https://github.com/dbt-labs/dbt-spark/pull/262/)) | ||
- [@vingov](https://github.com/vingov) ([#210](https://github.com/dbt-labs/dbt-spark/pull/210)) | ||
|
||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
## dbt-spark 1.0.1 - April 19, 2022 | ||
|
||
### Fixes | ||
- Closes the connection properly ([#280](https://github.com/dbt-labs/dbt-spark/issues/280), [#285](https://github.com/dbt-labs/dbt-spark/pull/285)) | ||
- Make internal macros use macro dispatch to be overridable in child adapters ([#319](https://github.com/dbt-labs/dbt-spark/issues/319), [#320](https://github.com/dbt-labs/dbt-spark/pull/320)) | ||
|
||
### Under the hood | ||
- Configure insert_overwrite models to use parquet ([#301](https://github.com/dbt-labs/dbt-spark/issues/301)) | ||
|
||
### Contributors | ||
- [@ueshin](https://github.com/ueshin) ([#285](https://github.com/dbt-labs/dbt-spark/pull/285), [#320](https://github.com/dbt-labs/dbt-spark/pull/320)) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
# CHANGELOG | ||
|
||
To view information about the changelog operation we suggest reading this [README](https://github.com/dbt-labs/dbt-spark/blob/main/.changes/README.md) found in `dbt-spark`. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
# dbt-spark Changelog | ||
|
||
- This file provides a full account of all changes to `dbt-spark`. | ||
- Changes are listed under the (pre)release in which they first appear. Subsequent releases include changes from previous releases. | ||
- "Breaking changes" listed under a version may require action from end users or external maintainers when upgrading to that version. | ||
- Do not edit this file directly. This file is auto-generated using [changie](https://github.com/miniscruff/changie). For details on how to document a change, see [the contributing guide](https://github.com/dbt-labs/dbt-spark/blob/main/CONTRIBUTING.md#adding-changelog-entry) |
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,7 @@ | ||
kind: Features | ||
body: backport changie to 1.0.latest | ||
time: 2022-08-10T13:33:56.992461-05:00 | ||
custom: | ||
Author: mcknight-42 | ||
Issue: "417" | ||
PR: "426" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,62 @@ | ||
changesDir: .changes | ||
unreleasedDir: unreleased | ||
headerPath: header.tpl.md | ||
versionHeaderPath: "" | ||
changelogPath: CHANGELOG.md | ||
versionExt: md | ||
versionFormat: '## dbt-spark {{.Version}} - {{.Time.Format "January 02, 2006"}}' | ||
kindFormat: '### {{.Kind}}' | ||
changeFormat: '- {{.Body}} ([#{{.Custom.Issue}}](https://github.com/dbt-labs/dbt-spark/issues/{{.Custom.Issue}}), [#{{.Custom.PR}}](https://github.com/dbt-labs/dbt-spark/pull/{{.Custom.PR}}))' | ||
kinds: | ||
- label: Breaking Changes | ||
- label: Features | ||
- label: Fixes | ||
- label: Under the Hood | ||
- label: Dependencies | ||
changeFormat: '- {{.Body}} ({{if ne .Custom.Issue ""}}[#{{.Custom.Issue}}](https://github.com/dbt-labs/dbt-spark/issues/{{.Custom.Issue}}), {{end}}[#{{.Custom.PR}}](https://github.com/dbt-labs/dbt-spark/pull/{{.Custom.PR}}))' | ||
- label: Security | ||
changeFormat: '- {{.Body}} ({{if ne .Custom.Issue ""}}[#{{.Custom.Issue}}](https://github.com/dbt-labs/dbt-spark/issues/{{.Custom.Issue}}), {{end}}[#{{.Custom.PR}}](https://github.com/dbt-labs/dbt-spark/pull/{{.Custom.PR}}))' | ||
custom: | ||
- key: Author | ||
label: GitHub Username(s) (separated by a single space if multiple) | ||
type: string | ||
minLength: 3 | ||
- key: Issue | ||
label: GitHub Issue Number | ||
type: int | ||
minLength: 4 | ||
- key: PR | ||
label: GitHub Pull Request Number | ||
type: int | ||
minLength: 4 | ||
footerFormat: | | ||
{{- $contributorDict := dict }} | ||
{{- /* any names added to this list should be all lowercase for later matching purposes */}} | ||
{{- $core_team := list "emmyoop" "nathaniel-may" "gshank" "leahwicz" "chenyulinx" "stu-k" "iknox-fa" "versusfacit" "mcknight-42" "jtcohen6" "dependabot[bot]" "snyk-bot" }} | ||
{{- range $change := .Changes }} | ||
{{- $authorList := splitList " " $change.Custom.Author }} | ||
{{- /* loop through all authors for a PR */}} | ||
{{- range $author := $authorList }} | ||
{{- $authorLower := lower $author }} | ||
{{- /* we only want to include non-core team contributors */}} | ||
{{- if not (has $authorLower $core_team)}} | ||
{{- $pr := $change.Custom.PR }} | ||
{{- /* check if this contributor has other PRs associated with them already */}} | ||
{{- if hasKey $contributorDict $author }} | ||
{{- $prList := get $contributorDict $author }} | ||
{{- $prList = append $prList $pr }} | ||
{{- $contributorDict := set $contributorDict $author $prList }} | ||
{{- else }} | ||
{{- $prList := list $change.Custom.PR }} | ||
{{- $contributorDict := set $contributorDict $author $prList }} | ||
{{- end }} | ||
{{- end}} | ||
{{- end}} | ||
{{- end }} | ||
{{- /* no indentation here for formatting so the final markdown doesn't have unneeded indentations */}} | ||
{{- if $contributorDict}} | ||
### Contributors | ||
{{- range $k,$v := $contributorDict }} | ||
- [@{{$k}}](https://github.com/{{$k}}) ({{ range $index, $element := $v }}{{if $index}}, {{end}}[#{{$element}}](https://github.com/dbt-labs/dbt-spark/pull/{{$element}}){{end}}) | ||
{{- end }} | ||
{{- end }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,61 @@ | ||
# **what?** | ||
# When bots create a PR, this action will add a corresponding changie yaml file to that | ||
# PR when a specific label is added. | ||
# | ||
# The file is created off a template: | ||
# | ||
# kind: <per action matrix> | ||
# body: <PR title> | ||
# time: <current timestamp> | ||
# custom: | ||
# Author: <PR User Login (generally the bot)> | ||
# Issue: 4904 | ||
# PR: <PR number> | ||
# | ||
# **why?** | ||
# Automate changelog generation for more visability with automated bot PRs. | ||
# | ||
# **when?** | ||
# Once a PR is created, label should be added to PR before or after creation. You can also | ||
# manually trigger this by adding the appropriate label at any time. | ||
# | ||
# **how to add another bot?** | ||
# Add the label and changie kind to the include matrix. That's it! | ||
# | ||
|
||
name: Bot Changelog | ||
|
||
on: | ||
pull_request: | ||
# catch when the PR is opened with the label or when the label is added | ||
types: [opened, labeled] | ||
|
||
permissions: | ||
contents: write | ||
pull-requests: read | ||
|
||
jobs: | ||
generate_changelog: | ||
strategy: | ||
matrix: | ||
include: | ||
- label: "dependencies" | ||
changie_kind: "Dependency" | ||
- label: "snyk" | ||
changie_kind: "Security" | ||
runs-on: ubuntu-latest | ||
|
||
steps: | ||
|
||
- name: Create and commit changelog on bot PR | ||
if: "contains(github.event.pull_request.labels.*.name, ${{ matrix.label }})" | ||
id: bot_changelog | ||
uses: emmyoop/changie_bot@v1.0 | ||
with: | ||
GITHUB_TOKEN: ${{ secrets.FISHTOWN_BOT_PAT }} | ||
commit_author_name: "Github Build Bot" | ||
commit_author_email: "<buildbot@fishtownanalytics.com>" | ||
commit_message: "Add automated changelog yaml from template for bot PR" | ||
changie_kind: ${{ matrix.changie_kind }} | ||
label: ${{ matrix.label }} | ||
custom_changelog_string: "custom:\n Author: ${{ github.event.pull_request.user.login }}\n Issue: 417\n PR: ${{ github.event.pull_request.number }}\n" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,41 @@ | ||
# **what?** | ||
# Checks that a file has been committed under the /.changes directory | ||
# as a new CHANGELOG entry. Cannot check for a specific filename as | ||
# it is dynamically generated by change type and timestamp. | ||
# This workflow should not require any secrets since it runs for PRs | ||
# from forked repos. | ||
# By default, secrets are not passed to workflows running from | ||
# a forked repo. | ||
|
||
# **why?** | ||
# Ensure code change gets reflected in the CHANGELOG. | ||
|
||
# **when?** | ||
# This will run for all PRs going into main and *.latest. It will | ||
# run when they are opened, reopened, when any label is added or removed | ||
# and when new code is pushed to the branch. The action will then get | ||
# skipped if the 'Skip Changelog' label is present is any of the labels. | ||
|
||
name: Check Changelog Entry | ||
|
||
on: | ||
pull_request: | ||
types: [opened, reopened, labeled, unlabeled, synchronize] | ||
workflow_dispatch: | ||
|
||
defaults: | ||
run: | ||
shell: bash | ||
|
||
permissions: | ||
contents: read | ||
pull-requests: write | ||
|
||
|
||
jobs: | ||
changelog: | ||
uses: dbt-labs/actions/.github/workflows/changelog-existence.yml@main | ||
with: | ||
changelog_comment: 'Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the [dbt-spark contributing guide](https://github.com/dbt-labs/dbt-spark/blob/main/CONTRIBUTING.MD).' | ||
skip_label: 'Skip Changelog' | ||
secrets: inherit # this is only acceptable because we own the action we're calling |
Oops, something went wrong.