Merge branch 'develop' into feature/partition-versioning

.github/ISSUE_TEMPLATE/bug-report.md

@@ -8,21 +8,21 @@ assignees: ''
 ---
 
 ## Description
-Short description of the problem here.
+<!-- Short description of the problem here. -->
 
 ## Context
-How has this bug affected you? What were you trying to accomplish?
+<!-- How has this bug affected you? What were you trying to accomplish? -->
 
 ## Steps to Reproduce
-1. [First Step]
+<!-- 1. [First Step]
 2. [Second Step]
-3. [And so on...]
+3. [And so on...] -->
 
 ## Expected Result
-Tell us what should happen.
+<!-- Tell us what should happen. -->
 
 ## Actual Result
-Tell us what happens instead.
+<!-- Tell us what happens instead. -->
 
 ```
 -- If you received an error, place it here.
@@ -33,7 +33,7 @@ Tell us what happens instead.
 ```
 
 ## Your Environment
-Include as many relevant details about the environment in which you experienced the bug:
+<!-- Include as many relevant details about the environment in which you experienced the bug: -->
 
 * Kedro version used (`pip show kedro` or `kedro -V`):
 * Python version used (`python -V`):

.github/ISSUE_TEMPLATE/config.yml

@@ -1,11 +1,11 @@
 blank_issues_enabled: false
 contact_links:
-  - name: Discord server
+  - name: Slack organisation
     about: Come chat with the community!
-    url: https://discord.gg/akJDeVaxnB
+    url: https://slack.kedro.org/
   - name: Documentation
     url: https://kedro.readthedocs.io/en/stable/
     about: To learn more about how Kedro works
-  - name: Case studies, articles and video tutorials
-    url: https://github.com/quantumblacklabs/kedro-community
-    about: Community-generated content, project examples and video tutorials
+  - name: Website
+    url: https://kedro.org/
+    about: Learn about features, project examples and our demo

.github/ISSUE_TEMPLATE/design-doc.md

@@ -8,37 +8,29 @@ assignees: ''
 ---
 
 ## Introduction
-
-A high-level, short overview of the problem(s) you are designing a solution for.
+<!-- A high-level, short overview of the problem(s) you are designing a solution for. -->
 
 ## Background
-
-Provide the reader with the context surrounding the problem(s) you are trying to solve.
+<!-- Provide the reader with the context surrounding the problem(s) you are trying to solve. -->
 
 ## Problem
-
-Be as concrete as you can about:
+<!-- Be as concrete as you can about: -->
 
 ### What's in scope
 
 ### What's not in scope
 
 ## Design
-
-Explain your design to the solution here. Diagrams could help.
+<!-- Explain your design to the solution here. Diagrams could help. -->
 
 ### Alternatives considered
-
-Explain the trade off between different alternatives to your solution.
+<!-- Explain the trade off between different alternatives to your solution. -->
 
 ## Testing
-
-Explain the testing strategies to verify your design correctness (if possible).
+<!-- Explain the testing strategies to verify your design correctness (if possible). -->
 
 ## Rollout strategy
-
-Is the change backward compatible? If not, what is the migration strategy?
+<!-- Is the change backward compatible? If not, what is the migration strategy? -->
 
 ## Future iterations
-
-Will there be future iterations of this design?
+<!-- Will there be future iterations of this design? -->

.github/ISSUE_TEMPLATE/feature-request.md

@@ -8,13 +8,13 @@ assignees: ''
 ---
 
 ## Description
-Is your feature request related to a problem? A clear and concise description of what the problem is: "I'm always frustrated when ..."
+<!-- Is your feature request related to a problem? A clear and concise description of what the problem is: "I'm always frustrated when ..." -->
 
 ## Context
-Why is this change important to you? How would you use it? How can it benefit other users?
+<!-- Why is this change important to you? How would you use it? How can it benefit other users? -->
 
 ## Possible Implementation
-(Optional) Suggest an idea for implementing the addition or change.
+<!-- (Optional) Suggest an idea for implementing the addition or change. -->
 
 ## Possible Alternatives
-(Optional) Describe any alternative solutions or features you've considered.
+<!-- (Optional) Describe any alternative solutions or features you've considered. -->

.github/PULL_REQUEST_TEMPLATE.md

@@ -1,3 +1,6 @@
+> **NOTE:** Kedro datasets are moving from `kedro.extras.datasets` to a separate `kedro-datasets` package in
+> [`kedro-plugins` repository](https://github.com/kedro-org/kedro-plugins). Any changes to the dataset implementations
+> should be done by opening a pull request in that repository.
 ## Description
 <!-- Why was this PR created? -->
 
@@ -6,16 +9,8 @@
 
 ## Checklist
 
-- [ ] Read the [contributing](https://github.com/quantumblacklabs/kedro/blob/master/CONTRIBUTING.md) guidelines
+- [ ] Read the [contributing](https://github.com/kedro-org/kedro/blob/main/CONTRIBUTING.md) guidelines
 - [ ] Opened this PR as a 'Draft Pull Request' if it is work-in-progress
 - [ ] Updated the documentation to reflect the code changes
-- [ ] Added a description of this change and added my name to the list of supporting contributions in the [`RELEASE.md`](https://github.com/quantumblacklabs/kedro/blob/master/RELEASE.md) file
+- [ ] Added a description of this change in the [`RELEASE.md`](https://github.com/kedro-org/kedro/blob/main/RELEASE.md) file
 - [ ] Added tests to cover my changes
-
-## Notice
-
-- [ ] I acknowledge and agree that, by checking this box and clicking "Submit Pull Request":
-
-- I submit this contribution under the [Apache 2.0 license](https://www.apache.org/licenses/LICENSE-2.0.txt) and represent that I am entitled to do so on behalf of myself, my employer, or relevant third parties, as applicable.
-- I certify that (a) this contribution is my original creation and / or (b) to the extent it is not my original creation, I am authorised to submit this contribution on behalf of the original creator(s) or their licensees.
-- I certify that the use of this contribution as authorised by the Apache 2.0 license does not violate the intellectual property rights of anyone else.

.github/dco.yml

@@ -0,0 +1,2 @@
+require:
+  members: false

.github/dependabot.yml

@@ -0,0 +1,13 @@
+# To get started with Dependabot version updates, you'll need to specify which
+# package ecosystems to update and where the package manifests are located.
+# Please see the documentation for all configuration options:
+# https://docs.github.com/github/administering-a-repository/configuration-options-for-dependency-updates
+
+version: 2
+updates:
+  - package-ecosystem: "pip" # See documentation for possible values
+    directory: "/" # Location of package manifests
+    schedule:
+      interval: "weekly"
+    labels:
+      - "dependencies"

.github/stale.yml

@@ -2,6 +2,9 @@
 daysUntilStale: 60
 # Number of days of inactivity before a stale issue is closed
 daysUntilClose: 7
+# Only issues or pull requests with all of these labels are checked if stale. Defaults to `[]` (disabled)
+onlyLabels:
+  - Community
 # Issues with these labels will never be considered stale
 exemptLabels:
   - pinned

.github/workflows/all-checks.yml

@@ -0,0 +1,46 @@
+name: Run all checks on Kedro
+
+on:
+  push:
+    branches:
+      - main
+      - develop
+    paths-ignore:
+      - "docs/**"
+  pull_request:
+    branches:
+      - main
+      - develop
+    paths-ignore:
+      - "docs/**"
+
+jobs:
+  unit-tests:
+    strategy:
+      matrix:
+        os: [ ubuntu-latest, windows-latest ]
+        python-version: [ "3.7", "3.8", "3.9", "3.10" ]
+    uses: ./.github/workflows/unit-tests.yml
+    with:
+      os: ${{ matrix.os }}
+      python-version: ${{ matrix.python-version }}
+
+  lint:
+    strategy:
+      matrix:
+        os: [ ubuntu-latest ]
+        python-version: [ "3.10" ]
+    uses: ./.github/workflows/lint.yml
+    with:
+      os: ${{ matrix.os }}
+      python-version: ${{ matrix.python-version }}
+
+  e2e-tests:
+    strategy:
+      matrix:
+        os: [ ubuntu-latest, windows-latest ]
+        python-version: [ "3.7", "3.8", "3.9", "3.10" ]
+    uses: ./.github/workflows/e2e-tests.yml
+    with:
+      os: ${{ matrix.os }}
+      python-version: ${{ matrix.python-version }}

.github/workflows/docs-only-checks.yml

@@ -0,0 +1,26 @@
+name: Run linter on Kedro Docs
+
+on:
+  push:
+    branches:
+      - main
+      - develop
+    paths:
+      - "docs/**"
+  pull_request:
+    branches:
+      - main
+      - develop
+    paths:
+      - "docs/**"
+
+jobs:
+  lint-tests:
+    strategy:
+      matrix:
+        os: [ ubuntu-latest ]
+        python-version: [ "3.7", "3.8", "3.9", "3.10" ]
+    uses: ./.github/workflows/lint.yml
+    with:
+      os: ${{ matrix.os }}
+      python-version: ${{ matrix.python-version }}

.github/workflows/e2e-tests.yml

@@ -0,0 +1,46 @@
+name: Run e2e-tests on Kedro
+
+on:
+  workflow_call:
+    inputs:
+      os:
+        type: string
+      python-version:
+        type: string
+
+env:
+  COLUMNS: 120
+  LINES: 25
+
+jobs:
+  e2e-tests:
+    runs-on: ${{ inputs.os }}
+    steps:
+      - name: Checkout code
+        uses: actions/checkout@v3
+      - name: Set up Python ${{inputs.python-version}}
+        uses: actions/setup-python@v3
+        with:
+          python-version: ${{inputs.python-version}}
+      - run: make install-pip-setuptools
+      - name: Cache python packages for Linux
+        if: inputs.os == 'ubuntu-latest'
+        uses: actions/cache@v3
+        with:
+          path: ~/.cache/pip
+          key: ${{inputs.os}}-python-${{inputs.python-version}}
+      - name: Cache python packages for Windows
+        if: inputs.os == 'windows-latest'
+        uses: actions/cache@v3
+        with:
+          path: ~\AppData\Local\pip\Cache
+          key: ${{inputs.os}}-python-${{inputs.python-version}}
+      - name: Install dependencies
+        run: |
+          pip --version
+          make install-test-requirements
+          make install-pre-commit
+      - name: pip freeze
+        run: pip freeze
+      - name: Run e2e tests
+        run: make e2e-tests

.github/workflows/lint.yml

@@ -0,0 +1,32 @@
+name: Run linters on Kedro
+
+on:
+  workflow_call:
+    inputs:
+      os:
+        type: string
+      python-version:
+        type: string
+
+jobs:
+  lint:
+    runs-on: ${{ inputs.os }}
+    steps:
+      - name: Checkout code
+        uses: actions/checkout@v3
+      - name: Set up Python ${{ inputs.python-version }}
+        uses: actions/setup-python@v3
+        with:
+          python-version: ${{ inputs.python-version }}
+      - name: Cache python packages
+        uses: actions/cache@v3
+        with:
+          path: ~/.cache/pip
+          key: ${{inputs.os}}-python-${{inputs.python-version}}
+      - name: Install dependencies
+        run: |
+            make install-test-requirements
+            make install-pre-commit
+            pip freeze
+      - name: Run linter
+        run: make lint

.github/workflows/merge-gatekeeper.yml

@@ -0,0 +1,27 @@
+name: Merge Gatekeeper
+
+on:
+  pull_request:
+    branches:
+      - main
+      - develop
+
+jobs:
+  merge-gatekeeper:
+    runs-on: ubuntu-latest
+    # Restrict permissions of the GITHUB_TOKEN.
+    # Docs: https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs
+    permissions:
+      checks: read
+      statuses: read
+    steps:
+      - name: Run Merge Gatekeeper
+        # NOTE: v1 is updated to reflect the latest v1.x.y. Please use any tag/branch that suits your needs:
+        #       https://github.com/upsidr/merge-gatekeeper/tags
+        #       https://github.com/upsidr/merge-gatekeeper/branches
+        uses: upsidr/merge-gatekeeper@v1
+        with:
+          token: ${{ secrets.GITHUB_TOKEN }}
+          timeout: 1800
+          interval: 30
+          ignored: 'ci/circleci: win_e2e_tests-3.7,ci/circleci: win_pip_compile-3.9,ci/circleci: win_e2e_tests-3.9,ci/circleci: win_pip_compile-3.8,ci/circleci: lint-3.7,ci/circleci: win_pip_compile-3.7,ci/circleci: pip_compile-3.7,ci/circleci: e2e_tests-3.7,ci/circleci: win_unit_tests-3.7,ci/circleci: win_unit_tests-3.9,ci/circleci: e2e_tests-3.8,ci/circleci: win_unit_tests-3.10,ci/circleci: win_pip_compile-3.10,ci/circleci: win_unit_tests-3.8,ci/circleci: e2e_tests-3.9,ci/circleci: unit_tests-3.10,ci/circleci: unit_tests-3.8,ci/circleci: e2e_tests-3.10,ci/circleci: lint-3.8,ci/circleci: unit_tests-3.9,ci/circleci: unit_tests-3.7,ci/circleci: win_e2e_tests-3.10,ci/circleci: pip_compile-3.8,ci/circleci: pip_compile-3.10,ci/circleci: win_e2e_tests-3.8,ci/circleci: lint-3.9,ci/circleci: pip_compile-3.9,ci/circleci: lint-3.10,build_code,ci/circlecici: check-updated-files,regular'