This repository has been archived by the owner on Jan 9, 2020. It is now read-only.
·
54 commits
to branch-2.2-kubernetes
since this release
Spark-on-Kubernetes release rebased from the Apache Spark 2.2 branch
Features available with this release include:
- Cluster-mode submission of Spark jobs to a Kubernetes cluster
- Support for Scala, Java and PySpark
- Static and Dynamic Allocation for Executors
- Automatic staging of local resources onto Driver and Executor pods
- Configurable security and credential management
- HDFS, running on the Kubernetes cluster or externally
- Launch jobs using kubectl proxy
- Support for Kubernetes 1.6 - 1.7
- Pre-built docker images