Skip to content
This repository has been archived by the owner on Nov 23, 2024. It is now read-only.

Compiler benchmarks #130

Open
jmackie opened this issue Jan 5, 2023 · 1 comment · May be fixed by #219
Open

Compiler benchmarks #130

jmackie opened this issue Jan 5, 2023 · 1 comment · May be fixed by #219
Labels
enhancement New feature or request

Comments

@jmackie
Copy link
Member

jmackie commented Jan 5, 2023

We need benchmarks to guide optimization work and catch performance regressions.

At the very least we should be benchmarking:

  • Parsing
  • Type checking
  • Code generation

There's probably no point in doing this until the language/syntax has reached some kind of stability, as each new addition would probably make previous benchmarks redundant.

github-action-benchmark supports Rust, so makes sense to use that initially. It also supports syncing benchmark results with a GitHub pages branch, which would be neat.

The Cargo example for github-action-benchmark uses libtest, so I reckon we start with that initially. We can then consider moving to criterion once everything's working and/or there is a need for it.

@jmackie jmackie converted this from a draft issue Jan 5, 2023
@jmackie jmackie added the enhancement New feature or request label Jan 5, 2023
@jmackie
Copy link
Member Author

jmackie commented Mar 11, 2023

github-action-benchmark supports Rust, so makes sense to use that initially. It also supports syncing benchmark results with a GitHub pages branch, which would be neat.

Turns out running benchmarks on GitHub actions isn't very sensible, more info here.

@jmackie jmackie linked a pull request Mar 11, 2023 that will close this issue
1 task
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
Status: No status
Development

Successfully merging a pull request may close this issue.

1 participant