Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

spinquic assert failure during cleanup phase #4347

Open
1 of 4 tasks
ami-GS opened this issue Jun 13, 2024 · 0 comments
Open
1 of 4 tasks

spinquic assert failure during cleanup phase #4347

ami-GS opened this issue Jun 13, 2024 · 0 comments
Labels
Area: Stress Related to stress testing with spinquic Bug: Core A code bug in the Core MsQuic code
Milestone

Comments

@ami-GS
Copy link
Contributor

ami-GS commented Jun 13, 2024

Describe the bug

Assert failure at the end of spinquic both.
As far as comment says, it is during "Clean up any leftover stateless operations being tracked."

(gdb) bt
#0  __pthread_kill_implementation (no_tid=0, signo=6, threadid=140736934696512) at ./nptl/pthread_kill.c:44
#1  __pthread_kill_internal (signo=6, threadid=140736934696512) at ./nptl/pthread_kill.c:78
#2  __GI___pthread_kill (threadid=140736934696512, signo=signo@entry=6) at ./nptl/pthread_kill.c:89
#3  0x00007ffff7603476 in __GI_raise (sig=sig@entry=6) at ../sysdeps/posix/raise.c:26
#4  0x00007ffff75e97f3 in __GI_abort () at ./stdlib/abort.c:79
#5  0x00007ffff7b454af in quic_bugcheck (File=0x7ffff7e695c8 "/home/daiki/workspace/msquic/src/inc/quic_platform_posix.h", Line=581, Expr=0x7ffff7e6b2b8 "pthread_mutex_lock(&(&Pool->Lock)->Mutex) == 0") at /home/daiki/workspace/msquic/src/platform/platform_posix.c:93
#6  0x00007ffff7af1328 in CxPlatPoolFree (Entry=0x7fff900d0f20, Pool=0x7fffc40d4680) at /home/daiki/workspace/msquic/src/inc/quic_platform_posix.h:581
#7  QuicBindingUninitialize (Binding=Binding@entry=0x7fff98215290) at /home/daiki/workspace/msquic/src/core/binding.c:222
#8  0x00007ffff7ac8c00 in QuicLibraryReleaseBinding (Binding=0x7fff98215290) at /home/daiki/workspace/msquic/src/core/library.c:2151
#9  0x00007ffff7af7d45 in QuicConnFree (Connection=Connection@entry=0x7fffcc30f950) at /home/daiki/workspace/msquic/src/core/connection.c:365
#10 0x00007ffff7ae6451 in QuicConnRelease (Ref=QUIC_CONN_REF_WORKER, Connection=0x7fffcc30f950) at /home/daiki/workspace/msquic/src/core/connection.h:1093
#11 QuicWorkerProcessConnection (Worker=Worker@entry=0x7fffc40d6420, Connection=0x7fffcc30f950, ThreadID=<optimized out>, TimeNow=TimeNow@entry=0x7fffdeffce10) at /home/daiki/workspace/msquic/src/core/worker.c:558
#12 0x00007ffff7ae6913 in QuicWorkerLoop (Context=0x7fffc40d6420, State=0x7fffdeffce10) at /home/daiki/workspace/msquic/src/core/worker.c:658
#13 0x00007ffff7b43462 in CxPlatRunExecutionContexts (Worker=Worker@entry=0x7fffe0004c70, State=State@entry=0x7fffdeffce10) at /home/daiki/workspace/msquic/src/platform/platform_worker.c:395
#14 0x00007ffff7b437f6 in CxPlatWorkerThread (Context=0x7fffe0004c70) at /home/daiki/workspace/msquic/src/platform/platform_worker.c:492
#15 0x00007ffff7655ac3 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:442
#16 0x00007ffff76e7850 in clone3 () at ../sysdeps/unix/sysv/linux/x86_64/clone3.S:81

Affected OS

  • Windows
  • Linux
  • macOS
  • Other (specify below)

Additional OS information

No response

MsQuic version

main

Steps taken to reproduce bug

pwsh ./scripts/build.ps1
./artifacts/bin/linux/x64_Debug_openssl3/spinquic both

Expected behavior

no issue

Actual outcome

./artifacts/bin/linux/x64_Debug_openssl3/spinquic both                                                                                                                                                                                                                                                                               
Using seed value: 0
Perf Counters:
  CONN_CREATED:          101431
  CONN_HANDSHAKE_FAIL:   14085
  CONN_APP_REJECT:       1670
  CONN_ACTIVE:           306
  CONN_CONNECTED:        92
  CONN_PROTOCOL_ERRORS:  2036
  CONN_NO_ALPN:          5303
  STRM_ACTIVE:           78
  PKTS_SUSPECTED_LOST:   5857
  PKTS_DROPPED:          26759
  PKTS_DECRYPTION_FAIL:  794
  UDP_RECV:              330999
  UDP_SEND:              404825
  UDP_RECV_BYTES:        293820293
  UDP_SEND_BYTES:        276811664
  UDP_RECV_EVENTS:       305562
  UDP_SEND_CALLS:        297977
  APP_SEND_BYTES:        7538146954
  APP_RECV_BYTES:        5548201
  CONN_QUEUE_DEPTH:      0
  CONN_OPER_QUEUE_DEPTH: 1
  CONN_OPER_QUEUED:      2058234
  CONN_OPER_COMPLETED:   2058231
  WORK_OPER_QUEUE_DEPTH: 0
  WORK_OPER_QUEUED:      10892
  WORK_OPER_COMPLETED:   10892
  PATH_VALIDATED:        0
  PATH_FAILURE:          0
  SEND_STATELESS_RESET:  9055
  SEND_STATELESS_RETRY:  1837
  CONN_LOAD_REJECT:      0
Perf Counters:
  CONN_CREATED:          101431
  CONN_HANDSHAKE_FAIL:   14136
  CONN_APP_REJECT:       1670
  CONN_ACTIVE:           12
  CONN_CONNECTED:        0
  CONN_PROTOCOL_ERRORS:  2036
  CONN_NO_ALPN:          5303
  STRM_ACTIVE:           0
  PKTS_SUSPECTED_LOST:   5857
  PKTS_DROPPED:          26789
  PKTS_DECRYPTION_FAIL:  794
  UDP_RECV:              331034
  UDP_SEND:              404832
  UDP_RECV_BYTES:        293858293
  UDP_SEND_BYTES:        276813266
  UDP_RECV_EVENTS:       305597
  UDP_SEND_CALLS:        297983
  APP_SEND_BYTES:        7538146954
  APP_RECV_BYTES:        5548201
  CONN_QUEUE_DEPTH:      0
  CONN_OPER_QUEUE_DEPTH: 0
  CONN_OPER_QUEUED:      2058637
  CONN_OPER_COMPLETED:   2058637
  WORK_OPER_QUEUE_DEPTH: 0
  WORK_OPER_QUEUED:      10897
  WORK_OPER_COMPLETED:   10897
  PATH_VALIDATED:        0
  PATH_FAILURE:          0
  SEND_STATELESS_RESET:  9060
  SEND_STATELESS_RETRY:  1837
  CONN_LOAD_REJECT:      0
[1]    2749305 IOT instruction (core dumped)  ./artifacts/bin/linux/x64_Debug_openssl3/spinquic both

Additional details

No response

@ami-GS ami-GS changed the title spinquic assert failure when accessing lock Jun 13, 2024
@nibanks nibanks added Bug: Core A code bug in the Core MsQuic code Area: Stress Related to stress testing with spinquic labels Jun 27, 2024
@nibanks nibanks added this to the Future milestone Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Stress Related to stress testing with spinquic Bug: Core A code bug in the Core MsQuic code
2 participants