Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

try running benchmarks on self hosted #4552

Closed
wants to merge 15 commits into from
Closed

Conversation

SimonDanisch
Copy link
Member

No description provided.

@MakieBot
Copy link
Collaborator

MakieBot commented Oct 31, 2024

Benchmark Results

SHA: 7157d8c21b170eaacdaef2c3feefe639cd017dd4

Warning

These results are subject to substantial noise because GitHub's CI runs on shared machines that are not ideally suited for benchmarking.

GLMakie
CairoMakie
WGLMakie

@SimonDanisch
Copy link
Member Author

Two take aways:

  1. It's suprising how similar the noise is for a complete dedicated machine, that has nothing else to do but run the benchmark on linux, even with the tips from BenchmarkTools applied : https://juliaci.github.io/BenchmarkTools.jl/stable/linuxtips/.
    We probably still need to make sure that we avoid thermal throttling (it's a mobile chip).
  2. It's crazy how much faster a dedicated machine is (from 25 min to 5min CI runtime), likely because the whole julia folder stays, without a lengthy up/download for the action cache and I guess a few other factors, like better CPU speed and GPU support.

I will close this for now, and come back to it later, when we have a dedicated machine for CI (still needs some containerisation + a stable location).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Closed
Development

Successfully merging this pull request may close these issues.

3 participants