Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix BenchmarkDotNet test adapter not running tests with dotnet test #2571

Merged
merged 2 commits into from
May 19, 2024

CR fixes

9569a62
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Fix BenchmarkDotNet test adapter not running tests with dotnet test #2571

CR fixes
9569a62
Select commit
Loading
Failed to load commit list.
GitHub Actions / report succeeded May 18, 2024 in 0s

report ✅

Tests passed successfully

Report Passed Failed Skipped Time
test-linux-trx/TestResults/linux-integration-net8.0.trx 221✅ 16⚪ 25m 32s 305ms
test-linux-trx/TestResults/linux-unit-net8.0.trx 885✅ 8⚪ 4s 246ms
test-macos-trx/TestResults/macos-integration-net8.0.trx 223✅ 16⚪ 26m 32s 318ms
test-macos-trx/TestResults/macos-unit-net8.0.trx 885✅ 8⚪ 4s 999ms
test-windows-core-trx/TestResults/windows-integration-net8.0.trx 230✅ 8⚪ 23m 20s 351ms
test-windows-full-trx/TestResults/windows-integration-net462.trx 252✅ 12⚪ 19m 48s 971ms

✅ test-linux-trx/TestResults/linux-integration-net8.0.trx

237 tests were completed in 25m 32s 305ms with 221 passed, 0 failed and 16 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 3m 16s 899ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 12s 541ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 4✅ 2m 15s 406ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 50s 735ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 1m 20s 355ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 13s 426ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 12s 349ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 49s 691ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 47s 103ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 46s 648ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 42s 628ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 42s 596ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 40s 958ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 40s 673ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 39s 210ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 37s 323ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 27s 183ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 20s 913ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 19s 587ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 18s 529ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 15s 884ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 14s 905ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 264ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 239ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 014ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 10s 897ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 9s 887ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 579ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 107ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 066ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 6s 956ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 6s 919ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 710ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 665ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 6s 632ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 626ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 624ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 6s 622ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 574ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 6s 480ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 6s 329ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 633ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 616ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 102ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 197ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 136ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 20ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 4ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 2ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 2ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-linux-trx/TestResults/linux-unit-net8.0.trx

893 tests were completed in 4s 246ms with 885 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 013ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 18✅ 1s 040ms
BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests 1✅ 646ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 385ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 376ms
BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests 6✅ 361ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 252ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 244ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 138ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 107ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 105ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 94ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 89ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 84ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 80ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 56ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 54ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 44ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 43ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 42ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 41ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 39ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 39ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 35ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 32ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 30ms
BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests 3✅ 29ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 28ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 25ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 24ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 22ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 20ms
BenchmarkDotNet.Tests.Environments.OsBrandStringTests 29✅ 17ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 15ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 14ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 14ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 13ms
BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests 24✅ 13ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 12ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 10ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 10ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 10ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 10ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 9ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 9ms
BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests 9✅ 8ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 8ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 7ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 7ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 7ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 7ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 6ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 6ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 6ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 6ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 5ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 5ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 32✅ 5ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 5ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 4ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 4ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 4ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 4ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 4ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 4ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 4ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 3ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 3ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 3ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 2ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 2ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 2ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 2ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 2ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 1ms
BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests 5✅ 1ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 1ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-macos-trx/TestResults/macos-integration-net8.0.trx

239 tests were completed in 26m 32s 318ms with 223 passed, 0 failed and 16 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 4m 12s 069ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 2m 39s 253ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 2m 09s 022ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 45s 118ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 37s 760ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 1m 27s 415ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 1m 02s 370ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 59s 183ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 51s 612ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 46s 039ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 45s 577ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 44s 537ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 44s 336ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 40s 064ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 30s 428ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 26s 263ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 25s 659ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 21s 532ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 19s 973ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 19s 738ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 18s 153ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 17s 673ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 17s 411ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 16s 147ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 12s 418ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 11s 345ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 10s 067ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 9s 760ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 9s 535ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 9s 511ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 9s 099ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 8s 993ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 8s 928ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 8s 922ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 8s 874ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 8s 808ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 8s 654ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 8s 651ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 8s 463ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 5s 803ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 5s 716ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 255ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 185ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 29ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 8✅ 20ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 5ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 4ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-macos-trx/TestResults/macos-unit-net8.0.trx

893 tests were completed in 4s 999ms with 885 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 619ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 18✅ 1s 418ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 1s 279ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 1s 039ms
BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests 1✅ 998ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 286ms
BenchmarkDotNet.Tests.ConfigParserTests 81✅ 3⚪ 267ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 236ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 183ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 157ms
BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests 6✅ 154ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 153ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 91ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 71ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 56ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 44ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests 12✅ 37ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 35ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 27✅ 2⚪ 33ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 30ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 10✅ 28ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 26ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 25ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 22ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 22ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 21ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 21ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 20ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 18ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 17ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 17ms
BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests 3✅ 16ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 16ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 16ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 15ms
BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests 9✅ 14ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 13ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 13ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 11ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 11ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 14✅ 11ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 10ms
BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests 10✅ 10ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 10ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 8ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 7ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 7ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 7ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 32✅ 7ms
BenchmarkDotNet.Tests.Environments.OsBrandStringTests 29✅ 6ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 6ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 6ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 6ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 6ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 5ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 5ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 5ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 5ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 5ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 4ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 4ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 4ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 4ms
BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests 24✅ 4ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 4ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 3ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 3ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 3ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 3ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 2ms
BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests 5✅ 2ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 2ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 2ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 2ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 1ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 1ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-windows-core-trx/TestResults/windows-integration-net8.0.trx

238 tests were completed in 23m 20s 351ms with 230 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 12✅ 3⚪ 3m 44s 867ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 55✅ 3m 16s 647ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 47s 543ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 14s 869ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 1m 13s 613ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 48s 761ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 47s 131ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 46s 313ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 43s 153ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 39s 987ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 39s 797ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 39s 428ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 36s 255ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 32s 350ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 28s 253ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 25s 787ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 21s 264ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 19s 978ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 19s 845ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 16s 725ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 15s 705ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 402ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 314ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 13s 303ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 192ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 11s 482ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 9s 403ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 9s 223ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 7s 977ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 7s 960ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 857ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 716ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 456ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 7s 273ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 099ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 017ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 888ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 6s 818ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 690ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 6s 655ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 653ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 647ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 601ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 401ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 388ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 200ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 2✅ 1⚪ 400ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 225ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 29ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 18ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 9ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 3ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-windows-full-trx/TestResults/windows-integration-net462.trx

264 tests were completed in 19m 48s 971ms with 252 passed, 0 failed and 12 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 12✅ 6m 51s 569ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 2m 38s 952ms
BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests 4✅ 2m 12s 214ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 53s 189ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 53s 019ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 52s 450ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 10✅ 5⚪ 44s 851ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 19✅ 2⚪ 41s 191ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 2✅ 39s 237ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 9✅ 37s 304ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 26s 383ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 53✅ 1⚪ 21s 478ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 14s 917ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 12s 911ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 10s 356ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 10s 340ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 7s 203ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 5s 383ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 4s 428ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 3s 577ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 4✅ 2s 369ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 2s 343ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 2s 040ms
BenchmarkDotNet.IntegrationTests.GcModeTests 7✅ 2s 011ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 1s 798ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 533ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 4✅ 1s 252ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 990ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 973ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 3✅ 906ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 842ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 836ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 826ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 636ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 576ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 566ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 554ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 551ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 335ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 305ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1✅ 299ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 291ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 286ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 278ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 275ms
BenchmarkDotNet.IntegrationTests.CopyToOutputTests 1✅ 270ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 261ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 259ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 130ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 50ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 34ms
BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests 3✅ 17ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 10ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 6ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 4ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.MonoTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms