Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build Docker image before E2E tests #413

Open
ivanyu opened this issue Oct 3, 2023 · 1 comment
Open

Build Docker image before E2E tests #413

ivanyu opened this issue Oct 3, 2023 · 1 comment

Comments

@ivanyu
Copy link
Contributor

ivanyu commented Oct 3, 2023

Currently, we build the image as a part of E2E test stage. Since E2E run in a type matrix, we build the image multiple times.

@jeqo
Copy link
Contributor

jeqo commented Mar 14, 2024

There are some mismatches that make this challenging: we build the library against different JDK versions, but package it in the same docker base image -- so effectively it runs with the same JDK version.
Then the JDK version matching between build and e2e doesn't matter much as the e2e is in a standalone classpath -- so there's no dependency between JDK versions to care here.

Another mismatch is that we need to build the image once, and pass it to a 2nd set of parallel jobs. To pass docker image between jobs we are constraint to upload/download: https://docs.docker.com/build/ci/github-actions/share-image-jobs/
which means ~1min operation with a ~1.2GB image size (mostly Confluent base image)

Leaving this for context if someone would like to tackle it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants