Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark simplification #4493

Merged
merged 17 commits into from
Oct 21, 2024
Merged

Benchmark simplification #4493

merged 17 commits into from
Oct 21, 2024

Conversation

jkrumbiegel
Copy link
Member

No description provided.

@MakieBot
Copy link
Collaborator

MakieBot commented Oct 16, 2024

Compile Times benchmark

Note, that these numbers may fluctuate on the CI servers, so take them with a grain of salt. All benchmark results are based on the mean time and negative percent mean faster than the base branch. Note, that GLMakie + WGLMakie run on an emulated GPU, so the runtime benchmark is much slower. Results are from running:

using_time = @ctime using Backend
# Compile time
create_time = @ctime fig = scatter(1:4; color=1:4, colormap=:turbo, markersize=20, visible=true)
display_time = @ctime Makie.colorbuffer(display(fig))
# Runtime
create_time = @benchmark fig = scatter(1:4; color=1:4, colormap=:turbo, markersize=20, visible=true)
display_time = @benchmark Makie.colorbuffer(fig)
using create display create display
GLMakie 6.21s (6.16, 6.33) 0.04+- 160.89ms (157.04, 168.29) 3.13+- 467.27ms (462.13, 476.21) 3.64+- 6.81ms (6.75, 6.90) 0.04+- 25.51ms (25.38, 26.00) 0.15+-
master 6.19s (6.12, 6.28) 0.05+- 160.70ms (157.72, 167.74) 2.10+- 469.38ms (461.48, 480.66) 5.98+- 6.76ms (6.68, 6.84) 0.05+- 25.59ms (25.39, 26.06) 0.19+-
evaluation 1.00x invariant, 0.02s (0.36d, 0.26p, 0.05std) 1.00x invariant, 0.19ms (0.07d, 0.82p, 2.61std) 1.00x invariant, -2.11ms (-0.43d, 0.19p, 4.81std) 0.99x slower X, 0.05ms (1.18d, 0.00p, 0.04std) 1.00x invariant, -0.08ms (-0.46d, 0.16p, 0.17std)
CairoMakie 6.10s (6.01, 6.19) 0.05+- 167.09ms (160.68, 192.88) 6.89+- 202.93ms (198.62, 209.05) 3.03+- 6.87ms (6.74, 7.24) 0.11+- 1.08ms (1.06, 1.10) 0.01+-
master 6.09s (5.96, 6.37) 0.08+- 167.34ms (160.50, 175.40) 4.17+- 201.52ms (196.65, 207.09) 2.83+- 6.87ms (6.69, 7.03) 0.09+- 1.09ms (1.07, 1.11) 0.01+-
evaluation 1.00x invariant, 0.01s (0.14d, 0.66p, 0.07std) 1.00x invariant, -0.25ms (-0.04d, 0.89p, 5.53std) 0.99x invariant, 1.41ms (0.48d, 0.14p, 2.93std) 1.00x invariant, 0.0ms (0.00d, 0.99p, 0.10std) 1.00x invariant, -0.0ms (-0.43d, 0.18p, 0.01std)
WGLMakie 6.45s (6.40, 6.49) 0.03+- 160.49ms (157.42, 162.64) 1.28+- 5.65s (5.43, 5.83) 0.14+- 10.30ms (10.10, 10.46) 0.11+- 144.91ms (142.01, 148.37) 1.49+-
master 6.45s (6.40, 6.54) 0.03+- 160.69ms (157.38, 163.97) 1.72+- 5.84s (5.69, 6.09) 0.11+- 10.23ms (10.11, 10.34) 0.07+- 144.78ms (141.25, 147.40) 1.88+-
evaluation 1.00x invariant, -0.0s (-0.05d, 0.87p, 0.03std) 1.00x invariant, -0.2ms (-0.14d, 0.67p, 1.50std) 1.03x faster ✓, -0.19s (-1.53d, 0.00p, 0.13std) 0.99x slower X, 0.07ms (0.81d, 0.02p, 0.09std) 1.00x invariant, 0.13ms (0.08d, 0.81p, 1.68std)

@jkrumbiegel jkrumbiegel added the skip-changelog Skips changelog enforcer label Oct 17, 2024
@SimonDanisch SimonDanisch merged commit 6b26779 into master Oct 21, 2024
17 of 18 checks passed
@SimonDanisch SimonDanisch deleted the jk/benchmark-simplifications branch October 21, 2024 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip-changelog Skips changelog enforcer
Projects
Status: Merged
Development

Successfully merging this pull request may close these issues.

3 participants