nativeaot/SmokeTests/Exceptions failing with `Assertion failed: (n_heaps <= heap_number) || !gc_t_join.joined()`

[elinor-fung]

Assertion failed: (n_heaps <= heap_number) || !gc_t_join.joined(), file D:\a\_work\1\s\src\coreclr\gc\gc.cpp, line 6988

Return code:      1
Raw output file:      C:\h\w\B51009A0\w\B29A098A\uploads\Reports\nativeaot.SmokeTests\Exceptions\Exceptions\Exceptions.output.txt
Raw output:
BEGIN EXECUTION
call C:\h\w\B51009A0\p\nativeaottest.cmd C:\h\w\B51009A0\w\B29A098A\e\nativeaot\SmokeTests\Exceptions\Exceptions\ Exceptions.dll 
Exception caught!
Null reference exception in write barrier caught!
Null reference exception caught!
Test Stacktrace with exception on stack:
   at BringUpTest.FilterWithStackTrace(Exception) + 0x28
   at BringUpTest.Main() + 0x31c
   at System.Runtime.EH.FindFirstPassHandler(Object, UInt32, StackFrameIterator&, UInt32&, Byte*&) + 0x188
   at System.Runtime.EH.DispatchEx(StackFrameIterator&, EH.ExInfo&) + 0x161
   at System.Runtime.EH.RhThrowEx(Object, EH.ExInfo&) + 0x4b
   at BringUpTest.Main() + 0xaf

Exception caught via filter!
Expected: 100
Actual: 3
END EXECUTION - FAILED

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=715849
Build error leg or test failing: nativeaot\SmokeTests\Exceptions\Exceptions\Exceptions.cmd
Pull request: #103821

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Assertion failed: (n_heaps <= heap_number) || !gc_t_join.joined()",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
782793	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106713
780945	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106662
779397	dotnet/runtime	readytorun/GenericCycleDetection/Depth1Test/Depth1Test.cmd	#80154
777119	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106474
777004	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106419
776719	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#105946
775455	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106309
770671	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution
769702	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106130
768094	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#106010
761651	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#105757
757283	dotnet/runtime	nativeaot.SmokeTests.WorkItemExecution	#105578

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	4	12

[dotnet-policy-service]

Tagging subscribers to this area: @agocke, @MichalStrehovsky, @jkotas
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to this area: @dotnet/gc
See info in area-owners.md if you want to be subscribed.

[jkotas]

Looks like a DATAs race condition. @dotnet/gc Could you please take a look?

Note that nativeaot\SmokeTests\Exceptions test is explicitly opted into server GC to get some coverage for server GC during default CI run.

[mrsharm]

Are there any dumps available? I can't seem to find them. Tried to repro locally to no avail. Seems like it's a low probability assertion failure (2 / month).