Skip to content

Commit

Permalink
add spark3.5.2
Browse files Browse the repository at this point in the history
  • Loading branch information
Ting Wei committed Aug 27, 2024
1 parent 947a1ab commit ccc4f19
Show file tree
Hide file tree
Showing 3 changed files with 78 additions and 1 deletion.
72 changes: 72 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -135,6 +135,78 @@ jobs:
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "8"
hadoop: "3.3.4"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "8"
hadoop: "3.3.4"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "8"
hadoop: "3.4.0"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "8"
hadoop: "3.4.0"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "11"
hadoop: "3.3.4"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "11"
hadoop: "3.3.4"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "11"
hadoop: "3.4.0"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "11"
hadoop: "3.4.0"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "17"
hadoop: "3.3.4"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "17"
hadoop: "3.3.4"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "17"
hadoop: "3.4.0"
scala: "2.12"
with_hive: "true"
with_pyspark: "true"
- spark: "3.5.2"
java: "17"
hadoop: "3.4.0"
scala: "2.13"
with_hive: "true"
with_pyspark: "true"
runs-on: ubuntu-20.04
env:
IMAGE_NAME: "spark-k8s"
Expand Down
2 changes: 1 addition & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
## v3

- (Temporarily drop support for R due to keyserver issues)
- Only supports for for 3.1.3, 3.2.2, 3.3.0, 3.4.1 (dropped 2.4.8).
- Only supports for for 3.1.3, 3.2.2, 3.3.0, 3.4.1, 3.5.2 (dropped 2.4.8).
- Supports both Java 8 and 11 for Spark 3 builds.
- Add Ubuntu-based image since the migration to eclipse-temurin for jre image source.

Expand Down
5 changes: 5 additions & 0 deletions templates/vars.yml
Original file line number Diff line number Diff line change
Expand Up @@ -19,4 +19,9 @@ versions:
- spark: ['3.4.1']
java: ['8', '11']
hadoop: ['3.3.4']
scala: ['2.12', '2.13']

- spark: ['3.5.2']
java: ['8', '11', '17']
hadoop: ['3.3.4', '3.4.0']
scala: ['2.12', '2.13']

0 comments on commit ccc4f19

Please sign in to comment.