[Known Build Error] Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll crash

[MichaelSimons]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1389317
Build error leg or test failing: Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.129.WorkItemExecution
Pull request: #53714

Note: this seems to happen only on the MacOS arm64 legs.

Error Message

{
  "ErrorMessage": "",
  "ErrorPattern": "Test process crashed with exit code 139\.[\s\S]*?Finished:    Microsoft.CodeAnalysis.NetAnalyzers.UnitTests",
  "BuildRetry": true,
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
1390961	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#53923
1390851	dotnet/sdk	dotnet-new.IntegrationTests.dll.1.WorkItemExecution	#53847
1390779	dotnet/sdk	dotnet.Tests.dll.13.WorkItemExecution	#53850
1388402	dotnet/sdk	dotnet.Tests.dll.9.WorkItemExecution	#54007
1382280	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#53923
1390465	dotnet/sdk	dotnet.Tests.dll.9.WorkItemExecution	#54031
1390651	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#53547
1389828	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#54019
1390628	dotnet/sdk	dotnet.Tests.dll.23.WorkItemExecution	#54004
1390605	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	#54025
1388987	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution	#53990
1390169	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#54028
1390310	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.197.WorkItemExecution	#53447
1390143	dotnet/sdk	Microsoft.NET.Build.Extensions.Tasks.Tests.dll.WorkItemExecution	#54026
1390051	dotnet/sdk	Microsoft.NET.Build.Containers.IntegrationTests.dll.2.WorkItemExecution	#53975
1390081	dotnet/sdk	Microsoft.DotNet.HotReload.Watch.Aspire.Tests.dll.2.WorkItemExecution	#53557
1390019	dotnet/sdk	Microsoft.NET.Build.Containers.IntegrationTests.dll.2.WorkItemExecution	#54002
1390122	dotnet/sdk	Microsoft.NET.Build.Containers.IntegrationTests.dll.2.WorkItemExecution	#54027
1389983	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.47.WorkItemExecution	#54022
1389998	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.187.WorkItemExecution	#53867
1389580	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.98.WorkItemExecution	#53820
1389885	dotnet/sdk	dotnet.Tests.dll.23.WorkItemExecution	#53850
1389871	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution	#53987
1388860	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#54011
1389738	dotnet/sdk	dotnet-new.IntegrationTests.dll.9.WorkItemExecution	#54017
1389632	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.AoT.Tests.dll.1.WorkItemExecution
1389446	dotnet/sdk	Microsoft.DotNet.HotReload.Watch.Aspire.Tests.dll.2.WorkItemExecution	#54015
1389422	dotnet/sdk	Microsoft.DotNet.HotReload.Watch.Aspire.Tests.dll.2.WorkItemExecution
1389317	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.129.WorkItemExecution	#53714
1387978	dotnet/sdk	Microsoft.DotNet.HotReload.Watch.Aspire.Tests.dll.2.WorkItemExecution	#54002

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
29	30	30

[jjonescz]

"ErrorMessage": "The Helix Work Item failed. Often this is due to a test crash. Please see the 'Artifacts' tab above for additional logs.",

@MichaelSimons This seems too broad, it will match any failing test. (And you can see in the table that other DLLs than Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll are indeed marked as "known failures" under this issue.)

[MichaelSimons]

"ErrorMessage": "The Helix Work Item failed. Often this is due to a test crash. Please see the 'Artifacts' tab above for additional logs.",

@MichaelSimons This seems too broad, it will match any failing test. (And you can see in the table that other DLLs than Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll are indeed marked as "known failures" under this issue.)

Thanks @jjonescz - I tried using a regex instead. This one is a little tricky to uniquely identify.

[MichaelSimons]

I think I need to close this and reconsider how to define the match...