[Perf] Changes at 7/6/2022 12:55:46 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BenchAssignRectangular - Duration of single invocation	1.73 secs	1.58 secs	0.91	0.00	False
BenchNumericSortRectangular - Duration of single invocation	1.67 secs	1.16 secs	0.69	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

Histogram

ByteMark.BenchAssignRectangular

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.584655135 < 1.6443023297539285.
IsChangePoint: Marked as a change because one of 5/11/2022 3:41:15 PM, 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 111.32365153249857 (T) = (0 -1585773909.911111) / Math.Sqrt((139767421829034.94 / (282)) + (4307325890840.445 / (3))) is greater than 1.9683819234322317 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (282) + (3) - 2, .975) and 0.08889012981764148 = (1740485930.191623 - 1585773909.911111) / 1740485930.191623 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### ByteMark.BenchNumericSortRectangular

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1619468092 < 1.5885620598983334.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 401.63533344720986 (T) = (0 -1159420712.6444445) / Math.Sqrt((608234657474.7343 / (282)) + (4878587888965.686 / (3))) is greater than 1.9683819234322317 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (282) + (3) - 2, .975) and 0.306539694453762 = (1671935225.9552476 - 1159420712.6444445) / 1671935225.9552476 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in Benchstone.MDBenchF.MDInvMt

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	9.98 ms	4.49 ms	0.45	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDInvMt*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchF.MDInvMt.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.490771911858974 < 9.479572406514137.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 66.85000621073063 (T) = (0 -4650229.740460928) / Math.Sqrt((7418817.478357051 / (282)) + (19071915532.28202 / (3))) is greater than 1.9683819234322317 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (282) + (3) - 2, .975) and 0.5340625297219271 = (9980372.983708858 - 4650229.740460928) / 9980372.983708858 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in Benchstone.MDBenchF.MDInProd

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	4.03 secs	3.36 secs	0.83	0.16	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDInProd*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchF.MDInProd.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3576989049333332 < 3.69568332093.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 26.145018097120964 (T) = (0 -3315440161.4833336) / Math.Sqrt((9013787741635556 / (281)) + (1340331256409157.8 / (3))) is greater than 1.968411900500806 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (281) + (3) - 2, .975) and 0.14716791165520285 = (3887564981.188785 - 3315440161.4833336) / 3887564981.188785 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[kunalspathak]

dotnet/runtime#70271