Skip to content

Commit

Permalink
add reports
Browse files Browse the repository at this point in the history
  • Loading branch information
@Zelzahn
Zelzahn committed May 27, 2024
1 parent d5a96ff commit cb8d1b4
Show file tree
Hide file tree
Showing 194 changed files with 32,508 additions and 5,254 deletions.
309 changes: 142 additions & 167 deletions native/hat/report/MAD.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
303 changes: 154 additions & 149 deletions native/hat/report/SD.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
547 changes: 295 additions & 252 deletions ...report/relative_iteration_times_small.svg → native/hat/report/both/iteration_times.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
338 changes: 338 additions & 0 deletions native/hat/report/both/pdf.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
239 changes: 117 additions & 122 deletions wasmtime/host/report/change/mean.svg → native/hat/report/change/mean.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
325 changes: 325 additions & 0 deletions native/hat/report/change/median.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
250 changes: 250 additions & 0 deletions native/hat/report/change/t-test.svg
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
106 changes: 91 additions & 15 deletions native/hat/report/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -118,33 +118,33 @@ <h4>Additional Statistics:</h4>
<tbody>
<tr>
<td>R&#xb2;</td>
<td class="ci-bound">0.0179936</td>
<td>0.0186438</td>
<td class="ci-bound">0.0179536</td>
<td class="ci-bound">0.0001052</td>
<td>0.0001081</td>
<td class="ci-bound">0.0001031</td>
</tr>
<tr>
<td>Mean</td>
<td class="ci-bound">5.2432 ms</td>
<td>5.4459 ms</td>
<td class="ci-bound">5.6550 ms</td>
<td class="ci-bound">7.3148 ms</td>
<td>7.3159 ms</td>
<td class="ci-bound">7.3174 ms</td>
</tr>
<tr>
<td title="Standard Deviation">Std. Dev.</td>
<td class="ci-bound">959.75 µs</td>
<td>1.0617 ms</td>
<td class="ci-bound">1.1248 ms</td>
<td class="ci-bound">2.1435 µs</td>
<td>6.5690 µs</td>
<td class="ci-bound">10.006 µs</td>
</tr>
<tr>
<td>Median</td>
<td class="ci-bound">4.6886 ms</td>
<td>4.6908 ms</td>
<td class="ci-bound">4.7069 ms</td>
<td class="ci-bound">7.3141 ms</td>
<td>7.3147 ms</td>
<td class="ci-bound">7.3155 ms</td>
</tr>
<tr>
<td title="Median Absolute Deviation">MAD</td>
<td class="ci-bound">6.9690 µs</td>
<td>10.719 µs</td>
<td class="ci-bound">36.807 µs</td>
<td class="ci-bound">1.7722 µs</td>
<td>2.1332 µs</td>
<td class="ci-bound">2.7432 µs</td>
</tr>
</tbody>
</table>
Expand Down Expand Up @@ -182,6 +182,82 @@ <h4>Understanding this report:</h4>
documentation</a> for more details on the additional statistics.</p>
</section>
</div>
<section class="plots">
<h3>Change Since Previous Benchmark</h3>
<div class="relative">
<table width="100%">
<tbody>
<tr>
<td>
<a href="both/pdf.svg">
<img src="relative_pdf_small.svg" alt="PDF Comparison" width="450"
height="300" />
</a>
</td>
<td>
<a href="both/iteration_times.svg">
<img src="relative_iteration_times_small.svg" alt="Iteration Time Comparison" width="450"
height="300" />
</a>
</td>
</tr>
</tbody>
</table>
</div>
</section>
<section class="stats">
<div class="additional_stats">
<h4>Additional Statistics:</h4>
<table>
<thead>
<tr>
<th></th>
<th title="0.95 confidence level" class="ci-bound">Lower bound</th>
<th>Estimate</th>
<th title="0.95 confidence level" class="ci-bound">Upper bound</th>
<th></th>
</tr>
</thead>
<tbody>
<tr>
<td>Change in time</td>
<td class="ci-bound">-0.0488%</td>
<td>+0.0431%</td>
<td class="ci-bound">+0.1749%</td>
<td>(p = 0.56 &gt;
0.05)</td>
</tr>
</tbody>
</table>
No change in performance detected.
</div>
<div class="additional_plots">
<h4>Additional Plots:</h4>
<ul>

<li>
<a href="change/mean.svg">Change in mean</a>
</li>
<li>
<a href="change/median.svg">Change in median</a>
</li>
<li>
<a href="change/t-test.svg">T-Test</a>
</li>
</ul>
</div>
</section>
<section class="explanation">
<h4>Understanding this report:</h4>
<p>The plot on the left shows the probability of the function taking a certain amount of time. The red
curve represents the saved measurements from the last time this benchmark was run, while the blue curve
shows the measurements from this run. The lines represent the mean time per iteration. Click on the
plot for a larger view.</p>
<p>The plot on the right shows the iteration times for the two measurements. Again, the red dots represent
the previous measurement while the blue dots show the current measurement.</p>
<p>See <a href="https://bheisler.github.io/criterion.rs/book/user_guide/command_line_output.html#change">the
documentation</a> for more details on the additional statistics.</p>
</section>
</div>
<div id="footer">
<p>This report was generated by
Expand Down
Loading

0 comments on commit cb8d1b4

Please sign in to comment.