Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate Kubeflow tests #2805

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
4ab31d7
Training operator CICD improvements (#2779)
juliusvonkohout Jul 26, 2024
53d6930
create seperate file for install_KinD_create_KinD_cluster_install_kus…
hansinikarunarathne Jul 22, 2024
10db369
make sh file executable
hansinikarunarathne Jul 22, 2024
75655d3
remove reduntant codes
hansinikarunarathne Jul 30, 2024
735cff7
combine kind, kuztomize and kind-cluster create sh files into one file
hansinikarunarathne Jul 30, 2024
ea8c4ed
fix issues with combined file
hansinikarunarathne Jul 30, 2024
425b0a4
fix configurations issues
hansinikarunarathne Jul 30, 2024
6542c4c
fix linting issues in workflow files
hansinikarunarathne Jul 30, 2024
ba534bc
fix trailing issues in workflow files
hansinikarunarathne Jul 30, 2024
4d2a032
fix trailing issues in workflow file bentoml
hansinikarunarathne Jul 30, 2024
0266c13
made tests/gh-actions/install_KinD_create_KinD_cluster_install_kustom…
hansinikarunarathne Aug 2, 2024
ef7080a
made modifications in workflow files
hansinikarunarathne Aug 2, 2024
8792230
deleted redundant files from tests folder
hansinikarunarathne Aug 2, 2024
7aca48c
Add kustomize installation file
hansinikarunarathne Aug 2, 2024
c1559f9
made install_kustomize.sh file executable
hansinikarunarathne Aug 2, 2024
e2a6ec7
made a fix
hansinikarunarathne Aug 2, 2024
a57a95f
fix issue with linting of YAML files (#2825)
hansinikarunarathne Aug 5, 2024
1cfd844
Expose Ray and Seldon to example kustomization.yaml file (#2834)
hansinikarunarathne Aug 5, 2024
159abc9
Increase the time out of notebook and katib test
hansinikarunarathne Aug 8, 2024
08e8f57
increase the timout time
hansinikarunarathne Aug 9, 2024
e847d4f
increase timeout of the create pipeline Run from Kubeflow Notebook to…
hansinikarunarathne Aug 9, 2024
6de8ebc
Add code to calculate time taken to pull a docker image
hansinikarunarathne Aug 14, 2024
3227d17
fix syntax error in yaml file
hansinikarunarathne Aug 14, 2024
33c0419
increase pipeline time
hansinikarunarathne Aug 14, 2024
12b1375
remove one step in action
hansinikarunarathne Aug 14, 2024
d925710
Added tests to tests/gh-actions to enable baseline and restricted PSS…
biswajit-9776 Aug 12, 2024
3702500
add kind cluster step into pss test yaml file
hansinikarunarathne Aug 14, 2024
c2d20ef
Merge branch 'master' into organize_kubeflow_tests
hansinikarunarathne Aug 14, 2024
087c017
change time pot time
hansinikarunarathne Aug 14, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 3 additions & 11 deletions .github/workflows/admission_webhook_test.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
name: Build & Apply PodDefaults manifests in KinD
on:

Check warning on line 2 in .github/workflows/admission_webhook_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/admission_webhook_test.yaml
- apps/admission-webhook/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -18,14 +16,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/bentoml_test.yaml
Original file line number Diff line number Diff line change
@@ -1,11 +1,9 @@
name: Build & Apply BentoML Yatai Stack manifests in KinD
on:

Check warning on line 2 in .github/workflows/bentoml_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/bentoml_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
- contrib/bentoml/**
Expand All @@ -17,14 +15,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install cert-manager
run: ./tests/gh-actions/install_cert_manager.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/centraldashboard_test.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
name: Build & Apply CentralDashboard manifests in KinD
on:

Check warning on line 2 in .github/workflows/centraldashboard_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/centraldashboard_test.yaml
- apps/centraldashboard/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/dex_test.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
name: Build & Apply Dex manifests in KinD
on:

Check warning on line 2 in .github/workflows/dex_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/dex_test.yaml
- common/dex/base/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/jupyter_web_application_test.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
name: Build & Apply JWA manifests in KinD
on:

Check warning on line 2 in .github/workflows/jupyter_web_application_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/jupyter_web_application_test.yaml
- apps/jupyter/jupyter-web-app/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/katib_test.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,10 @@
name: Build & Apply Katib manifests in KinD
on:

Check warning on line 2 in .github/workflows/katib_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/katib_test.yaml
- apps/katib/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -18,14 +16,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down Expand Up @@ -57,7 +49,7 @@
kubectl wait --for=condition=Running experiments.kubeflow.org -n kubeflow-user --all --timeout 300s

echo "Waiting for all Trials to become Succeeded..."
kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 300s
kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 1200s

echo "Waiting for the Experiment to become Succeeded..."
kubectl wait --for=condition=Succeeded experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
14 changes: 3 additions & 11 deletions .github/workflows/kserve_cni_test.yaml
Original file line number Diff line number Diff line change
@@ -1,11 +1,9 @@
name: Build & Apply KServe manifests in KinD, using istio CNI
on:

Check warning on line 2 in .github/workflows/kserve_cni_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_cni_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- common/istio-cni-1-22/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -20,14 +18,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/kserve_m2m_test.yaml
Original file line number Diff line number Diff line change
@@ -1,13 +1,11 @@
name: Deploy and test KServe with m2m auth in KinD
on:

Check warning on line 2 in .github/workflows/kserve_m2m_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_m2m_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/kserve/**
- common/oauth2-proxy/**
- common/oidc-client/oauth2-proxy/**
- common/istio*/**
- tests/gh-actions/install_istio_with_ext_auth.sh*
- tests/gh-actions/install_cert_manager.sh
Expand All @@ -23,18 +21,12 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/kserve_test.yaml
Original file line number Diff line number Diff line change
@@ -1,11 +1,9 @@
name: Build & Apply KServe manifests in KinD
on:

Check warning on line 2 in .github/workflows/kserve_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/kserve/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -20,14 +18,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/metacontroller_test.yaml
Original file line number Diff line number Diff line change
@@ -1,11 +1,9 @@
name: Build & Apply contrib/metacontroller in KinD
on:

Check warning on line 2 in .github/workflows/metacontroller_test.yaml

View workflow job for this annotation

GitHub Actions / format_YAML_files

2:1 [truthy] truthy value should be one of [false, true]
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/metacontroller_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/metacontroller/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -19,14 +17,8 @@
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config ./tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
13 changes: 3 additions & 10 deletions .github/workflows/model_registry_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,8 @@ name: Deploy and test Kubeflow Model Registry
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- apps/model-registry/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- common/istio*/**

Expand All @@ -17,18 +16,12 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/notebook_controller_m2m_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,10 @@ name: Test Notebook Controller with m2m auth manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/notebook_controller_m2m_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- apps/jupyter/**
- common/oauth2-proxy/**
- common/oidc-client/oauth2-proxy/**
- common/istio*/**
- tests/gh-actions/install_istio_with_ext_auth.sh*
- tests/gh-actions/install_multi_tenancy.sh
Expand All @@ -19,18 +17,12 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
Loading
Loading