From 420eae29c454f6e7e6a7837706ca2e6c0fe792b8 Mon Sep 17 00:00:00 2001 From: Mathew Wicks Date: Wed, 22 Jun 2022 19:26:06 +1000 Subject: [PATCH] chore: release 8.6.1 (#616) Signed-off-by: Mathew Wicks --- charts/airflow/CHANGELOG.md | 59 +++++++++++++++++++++++++++++++------ charts/airflow/Chart.yaml | 2 +- charts/airflow/README.md | 15 +++++----- 3 files changed, 59 insertions(+), 17 deletions(-) diff --git a/charts/airflow/CHANGELOG.md b/charts/airflow/CHANGELOG.md index 8ea20e88..7c59ff56 100644 --- a/charts/airflow/CHANGELOG.md +++ b/charts/airflow/CHANGELOG.md @@ -1,13 +1,59 @@ # Changelog -All notable changes to this project will be documented in this file. +All notable changes to the `User-Community Airflow Helm Chart` will be documented in this file. This project follows [Semantic Versioning](https://semver.org/spec/v2.0.0.html) and [Keep a Changelog](https://keepachangelog.com/en/1.0.0/). -## [Unreleased] - TBD +## [Unreleased] TBD +## [8.6.1] - 2022-06-22 + +> 🟥 __WARNINGS__ 🟥 +> +> - When using `extraPipPackages`, Pods will now fail to start if the `apache-airflow` version would be changed from the image version, +> see `airflow.protectedPipPackages` for more information. +> (NOTE: for critical deployments we STRONGLY recommend [embedding extra packages into the image](docs/faq/configuration/extra-python-packages.md#option-2---embedded-into-container-image) instead of using `extraPipPackages`) +> - The maximum length for a helm release-name has been lowered to `40` characters (down from `43`). +> Existing deployments with a helm release-name between `41` and `43` characters MUST enable the `allowLongReleaseName` value to continue using the chart. +> (NOTE: the embedded Postgres and Redis will not work with a release-name between `41` and `43` characters). + +> 🟨 __NOTES__ 🟨 +> +> - The chart now works with Airflow 2.3, however, please note the default image tag is still `2.2.5-python3.8`. +> - Storing [logs under `airflow.extraVolumeMounts` (Pod Volumes)](docs/faq/monitoring/log-persistence.md#option-3---pod-volumes) is now a supported usage pattern. +> - The [Scheduler "task creation check"](docs/faq/monitoring/scheduler-liveness-probe.md#scheduler-task-creation-check) now has the `scheduler.livenessProbe.taskCreationCheck.schedulerAgeBeforeCheck` +> value to ensure the scheduler has time to create tasks before starting the check. +> - Airflow 2.3.0 introduced BETA support for ARM CPUs (like Apple Silicon). +> The chart's current default images for Postgres/Redis only support `amd64`, +> however, you may test our drop-in replacements that support both `arm64` and `amd64`: +> - [`bitnami/postgresql`](https://hub.docker.com/r/bitnami/postgresql/) → [`ghcr.io/airflow-helm/postgresql-bitnami`](https://ghcr.io/airflow-helm/postgresql-bitnami) +> - [`bitnami/redis`](https://hub.docker.com/r/bitnami/redis/) → `TBA` + +> 🟦 __OTHER__ 🟦 +> +> - If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us! +> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers) +> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow) + +### Added +- add `airflow.protectedPipPackages` ([#610](https://github.com/airflow-helm/charts/pull/610)) +- allow using `extraVolumeMounts` for log storage ([#585](https://github.com/airflow-helm/charts/pull/585)) +- minimum scheduler age before task-creation-check ([#612](https://github.com/airflow-helm/charts/pull/612)) + +### Changed +- update `.helmignore` file to exclude docs ([#593](https://github.com/airflow-helm/charts/pull/593)) +- require release-name to have <= 40 characters ([#589](https://github.com/airflow-helm/charts/pull/589)) + +### Fixed +- fix some breaking changes from airflow 2.3.0 ([#592](https://github.com/airflow-helm/charts/pull/592)) +- fix wait-for-db-migrations in airflow 2.3.0 ([#576](https://github.com/airflow-helm/charts/pull/576)) +- fix pgbouncer liveness probe in minikube ([#560](https://github.com/airflow-helm/charts/pull/560)) +- use rsync for extraPipPackages ([#599](https://github.com/airflow-helm/charts/pull/599)) +- set `AIRFLOW__LOGGING__WORKER_LOG_SERVER_PORT` ([#608](https://github.com/airflow-helm/charts/pull/608)) +- only set `SQLALCHEMY_DATABASE_URI` in airflow 1.10 ([#609](https://github.com/airflow-helm/charts/pull/609)) + ## [8.6.0] - 2022-04-13 > 🟥 __WARNINGS__ 🟥 @@ -29,12 +75,6 @@ TBD > - The new [PgBouncer startupProbe](https://github.com/airflow-helm/charts/pull/547) will only work in Kubernetes 1.18+ > - The [`extraManifests` value](docs/faq/kubernetes/extra-manifests.md) has been significantly improved -> 🟦 __OTHER__ 🟦 -> -> - If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us! -> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers) -> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow) - ### Added - add "airflow triggerer" Deployment ([#555](https://github.com/airflow-helm/charts/pull/555)) - add "log-cleanup sidecar" to scheduler and worker ([docs](docs/faq/monitoring/log-cleanup.md)) ([#554](https://github.com/airflow-helm/charts/pull/554)) @@ -681,7 +721,8 @@ TBD > > - To read about versions `7.0.0` and before, please see the [legacy repo](https://github.com/helm/charts/tree/master/stable/airflow). -[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.6.0...HEAD +[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.6.1...HEAD +[8.6.1]: https://github.com/airflow-helm/charts/compare/airflow-8.6.0...airflow-8.6.1 [8.6.0]: https://github.com/airflow-helm/charts/compare/airflow-8.5.3...airflow-8.6.0 [8.5.3]: https://github.com/airflow-helm/charts/compare/airflow-8.5.2...airflow-8.5.3 [8.5.2]: https://github.com/airflow-helm/charts/compare/airflow-8.5.1...airflow-8.5.2 diff --git a/charts/airflow/Chart.yaml b/charts/airflow/Chart.yaml index dd16a097..ec5329dc 100644 --- a/charts/airflow/Chart.yaml +++ b/charts/airflow/Chart.yaml @@ -1,7 +1,7 @@ apiVersion: v2 description: Airflow Helm Chart (User Community) - the standard way to deploy Apache Airflow on Kubernetes with Helm name: airflow -version: 8.6.0 +version: 8.6.1 appVersion: 2.2.5 icon: https://airflow.apache.org/_images/pin_large.png home: https://github.com/airflow-helm/charts/tree/main/charts/airflow diff --git a/charts/airflow/README.md b/charts/airflow/README.md index c689364f..3e4c5701 100644 --- a/charts/airflow/README.md +++ b/charts/airflow/README.md @@ -61,7 +61,7 @@ and was previously known as `stable/airflow` when it was developed in the `helm/ ## Key Features - __Support for Airflow Versions:__ - - [`1.10` | `2.0` | `2.1` | `2.2`](#airflow-version-support) + - [`1.10` | `2.0` | `2.1` | `2.2` | `2.3`](#airflow-version-support) - __Support for Airflow Executors:__ - [`CeleryExecutor` | `KubernetesExecutor` | `CeleryKubernetesExecutor`](#airflow-executor-support) - __Easily Connect with your Database:__ @@ -151,12 +151,13 @@ and was previously known as `stable/airflow` when it was developed in the `helm/ The following table lists the __airflow versions__ supported by this chart (set by [`airflow.image.tag`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-version.md) value). -Chart Version →
Airflow Version ↓ | `7.0.0` - `7.16.0` | `8.0.0` - `8.5.3` | `8.6.0+` | ---- | --- | --- | --- -`1.10.X` | ✔️ | ⚠️ [1] | ⚠️ [1] -`2.0.X` | ❌ | ✔️ | ✔️ -`2.1.X` | ❌ | ✔️ | ✔️ -`2.2.X` | ❌ | ⚠️ [2] | ✔️️ +Chart Version →
Airflow Version ↓ | `7.0.0` - `7.16.0` | `8.0.0` - `8.5.3` | `8.6.0` | `8.6.1+` | +--- | --- | --- | --- | --- +`1.10.X` | ✔️ | ✔️ [1] | ✔️️ [1] | ✔️️ [1] +`2.0.X` | ❌ | ✔️ | ✔️ | ✔️ +`2.1.X` | ❌ | ✔️ | ✔️ | ✔️ +`2.2.X` | ❌ | ⚠️ [2] | ✔️️ | ✔️ +`2.3.X` | ❌ | ❌ | ❌ | ✔️️ [1] you must set `airflow.legacyCommands = true` when using airflow version `1.10.X`
[2] the [Deferrable Operators & Triggers](https://airflow.apache.org/docs/apache-airflow/stable/concepts/deferring.html) feature won't work, as there is no `airflow triggerer` Deployment