Skip to content

Commit

Permalink
Merge pull request #550 from vertica/547-daily-build-fails-on-standal…
Browse files Browse the repository at this point in the history
…one-cluster-due-to-nosuchmethoderror

Pinned Spark version to 3.3.2
  • Loading branch information
jbobson98 committed Jun 29, 2023
2 parents e6ef1d1 + 4afa0dd commit 99240e2
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
2 changes: 1 addition & 1 deletion docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ docker logs docker-hdfs-1

To use a specific version set the following environment variables in your environment, such as in your Docker `.env` file:
- `VERTICA_VERSION`: By default, we use the latest [Vertica](https://hub.docker.com/r/vertica/vertica-k8s) image. For example, to use Vertica 10.1.1-0 set `VERTICA_VERSION=10.1.1-0`.
- `SPARK_INSTALL`: By default, we use the latest [Bitnami Spark](https://hub.docker.com/r/bitnami/spark) image. For example, to use Spark 3.1.3 set `SPARK_INSTALL=3.1.3`.
- `SPARK_INSTALL`: By default, we use the 3.3.2 [Bitnami Spark](https://hub.docker.com/r/bitnami/spark) image. For example, to use Spark 3.1.3 set `SPARK_INSTALL=3.1.3`.

By default we start a single Spark worker. To start multiple Spark workers, such as 3 workers:
```sh
Expand Down
6 changes: 3 additions & 3 deletions docker/docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ services:
build:
context: ./client
args:
SPARK: ${SPARK_INSTALL:-latest}
SPARK: ${SPARK_INSTALL:-3.3.2}
ports:
# JVM Remote debug port
- "5005:5005"
Expand Down Expand Up @@ -62,7 +62,7 @@ services:
build:
context: ./client
args:
SPARK: ${SPARK_INSTALL:-latest}
SPARK: ${SPARK_INSTALL:-3.3.2}
ports:
- "8080:8080"
- "7077:7077"
Expand All @@ -81,7 +81,7 @@ services:
build:
context: ./client
args:
SPARK: ${SPARK_INSTALL:-latest}
SPARK: ${SPARK_INSTALL:-3.3.2}
# Uncomment these ports to access the Spark Worker logs in the UI (not possible when scaling beyond a single worker node)
#ports:
#- "8081:8081"
Expand Down

0 comments on commit 99240e2

Please sign in to comment.