[Perf] Changes at 7/6/2022 12:55:46 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in Benchstone.MDBenchF.MDLLoops

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	1.02 secs	962.22 ms	0.94	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDLLoops*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchF.MDLLoops.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 962.2239733333333 < 0.9705057881043957.
IsChangePoint: Marked as a change because one of 5/9/2022 6:32:22 AM, 6/2/2022 5:58:32 PM, 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 64.20413020906388 (T) = (0 -961800734.2857143) / Math.Sqrt((205731061238051.66 / (299)) + (1089518674313.857 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.06405850649977074 = (1027629121.013512 - 961800734.2857143) / 1027629121.013512 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in Benchstone.MDBenchF.MDInvMt

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	9.54 ms	4.30 ms	0.45	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDInvMt*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchF.MDInvMt.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 4.30465296474359 < 9.061392315848215.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 280.1318085903516 (T) = (0 -4326996.669464795) / Math.Sqrt((16000897.812495584 / (299)) + (1037726863.1591865 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.5463159438791815 = (9537466.902545264 - 4326996.669464795) / 9537466.902545264 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BenchAssignRectangular - Duration of single invocation	1.65 secs	1.52 secs	0.92	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

Histogram

ByteMark.BenchAssignRectangular

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.52007025 < 1.5682711523214286.
IsChangePoint: Marked as a change because one of 4/22/2022 1:40:09 PM, 5/8/2022 4:51:58 PM, 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 83.98349065038323 (T) = (0 -1521562476.6666667) / Math.Sqrt((160367914211491.16 / (299)) + (6646062937211.465 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.08387978105034144 = (1660876427.7805746 - 1521562476.6666667) / 1660876427.7805746 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	338db1a1ba498f308797ce7a54c0ed54e7286d50
Compare	206dccb7945aaa3f26599fbe742de9022ca7ef91
Diff	Diff

Improvements in Benchstone.MDBenchF.MDInProd

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	2.45 secs	2.21 secs	0.90	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchF.MDInProd*'

Payloads

Baseline
Compare

Histogram

Benchstone.MDBenchF.MDInProd.Test

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.21309092 < 2.327214515047619.
IsChangePoint: Marked as a change because one of 7/5/2022 7:51:46 PM, 7/6/2022 9:44:27 PM falls between 6/28/2022 4:38:49 AM and 7/6/2022 9:44:27 PM.
IsImprovementStdDev: Marked as improvement because 91.16255644178688 (T) = (0 -2208575161.025641) / Math.Sqrt((86856914573138.3 / (299)) + (20159355070372.4 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.0985207310667775 = (2449945591.804 - 2208575161.025641) / 2449945591.804 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[kunalspathak]

dotnet/runtime#70271