Code

Add solution#133

Code

Merged

holdenk merged 21 commits intohigh-performance-spark:mainhigh-performance-spark/high-performance-spark-examples:mainfrom holdenk:add-solutionholdenk/high-performance-spark-examples:add-solutionCopy head branch name to clipboardAug 15, 2024

+1,231-74

Commits

Commits on Aug 12, 2024

• Start working on sol nb

  holdenk

  committed
  3517b76

  Copy full SHA for 3517b76

Commits on Aug 13, 2024

• Finish update to Spark 3.5.2, download 2022 & 2023 data, install Python-is-Python3 so we can run the example.

  holdenk

  committed
  82ca904

  Copy full SHA for 82ca904

• Add solution

  holdenk

  committed
  74b82aa

  Copy full SHA for 74b82aa

Commits on Aug 14, 2024

• Ignore incubator-gluten

  holdenk

  committed
  18a2f0c

  Copy full SHA for 18a2f0c

• Update workshop NB

  holdenk

  committed
  1b9f4da

  Copy full SHA for 1b9f4da

• Install pyarrow & pyiceberg for folks who want to poke around at the parquet files.

  holdenk

  committed
  cd0271c

  Copy full SHA for cd0271c

• Update solutions

  holdenk

  committed
  b6d5a4a

  Copy full SHA for b6d5a4a

• More update

  holdenk

  committed
  176fc44

  Copy full SHA for 176fc44

• Forward the Spark UI for ze query plans.

  holdenk

  committed
  fde0665

  Copy full SHA for fde0665

• Update solution

  holdenk

  committed
  5461fea

  Copy full SHA for 5461fea

Commits on Aug 15, 2024

• Update solutions

  holdenk

  committed
  7749603

  Copy full SHA for 7749603

• Re-enable cross build, use launch script

  holdenk

  committed
  cbdcec3

  Copy full SHA for cbdcec3

• Make exec

  holdenk

  committed
  17d8329

  Copy full SHA for 17d8329

• Lets make a slimmed down container for folks who need it.

  holdenk

  committed
  2a27424

  Copy full SHA for 2a27424

• Fix spark home slim down mini some more

  Show description for c5ce5f1
  holdenk

  committed
  c5ce5f1

  Copy full SHA for c5ce5f1

• Tag mini image seperately

  holdenk

  committed
  f72a9f9

  Copy full SHA for f72a9f9

• Stack them

  holdenk

  committed
  b2ace5f

  Copy full SHA for b2ace5f

• Avoid pip cache dir

  holdenk

  committed
  046f121

  Copy full SHA for 046f121

• Don't keep the spark tarball in the image

  holdenk

  committed
  d5c541d

  Copy full SHA for d5c541d

• Seperate out build from run

  holdenk

  committed
  3344bc6

  Copy full SHA for 3344bc6

• shell check fixes

  holdenk

  committed
  f504154

  Copy full SHA for f504154