Uploaded image for project: 'Qpid Dispatch'
  1. Qpid Dispatch
  2. DISPATCH-2102

Shutdown crash when console connected

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.15.0
    • 1.20.0
    • Router Node
    • None

    Description

      code

      Proton git branch main @ 08b301a9. Dispatch git branch main @ 68c08365

      This is post-1.16.x branch point. Expect that problem exists on 1.16.x branch also.

      configuation

      Standard 12-node Crosslane network, with 12 echo servers and 144 listeners

      INTA config

      No specification of worker threads in router conf file

      Test that failed

      • Connected a console to INTA_http
      • Run a bunch of echo servers and clients. They all worked ok.
      • kill <pid> : all local routers on taj

      Backtrace

       gdb qdrouterd core.qdrouterd.1140630
      GNU gdb (GDB) Fedora 9.1-6.fc32
      Copyright (C) 2020 Free Software Foundation, Inc.
      License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
      This is free software: you are free to change and redistribute it.
      There is NO WARRANTY, to the extent permitted by law.
      Type "show copying" and "show warranty" for details.
      This GDB was configured as "x86_64-redhat-linux-gnu".
      Type "show configuration" for configuration details.
      For bug reporting instructions, please see:
      <http://www.gnu.org/software/gdb/bugs/>.
      Find the GDB manual and other documentation resources online at:
       <http://www.gnu.org/software/gdb/documentation/>.
      
      For help, type "help".
      Type "apropos word" to search for commands related to "word"...
      Reading symbols from qdrouterd...
      [New LWP 1140659]
      [New LWP 1140630]
      [Thread debugging using libthread_db enabled]
      Using host libthread_db library "/usr/lib64/libthread_db.so.1".
      
      Core was generated by `qdrouterd -c INTA.conf'.
      
      Program terminated with signal SIGABRT, Aborted.
      #0 0x00007f368c5b69e5 in raise () from /usr/lib64/libc.so.6
      [Current thread is 1 (Thread 0x7f367e5df700 (LWP 1140659))]
      Missing separate debuginfos, use: dnf debuginfo-install cyrus-sasl-gssapi-2.1.27-4.fc32.x86_64 cyrus-sasl-lib-2.1.27-4.fc32.x86_64 cyrus-sasl-md5-2.1.27-4.fc32.x86_64 cyrus-sasl-plain-2.1.27-4.fc32.x86_64 glibc-2.31-4.fc32.x86_64 keyutils-libs-1.6-4.fc32.x86_64 krb5-libs-1.18.2-29.fc32.x86_64 libcom_err-1.45.5-3.fc32.x86_64 libdb-5.3.28-40.fc32.x86_64 libev-4.31-2.fc32.x86_64 libffi-3.1-24.fc32.x86_64 libgcc-10.2.1-9.fc32.x86_64 libselinux-3.0-5.fc32.x86_64 libuv-1.39.0-1.fc32.x86_64 libwebsockets-3.2.2-2.fc32.x86_64 libxcrypt-4.4.17-1.fc32.x86_64 openssl-libs-1.1.1g-1.fc32.x86_64 pcre2-10.35-8.fc32.x86_64 python3-libs-3.8.6-1.fc32.x86_64 zlib-1.2.11-21.fc32.x86_64
      (gdb) bt
      #0 0x00007f368c5b69e5 in raise () from /usr/lib64/libc.so.6
      #1 0x00007f368c59f895 in abort () from /usr/lib64/libc.so.6
      #2 0x00007f368c59f769 in __assert_fail_base.cold () from /usr/lib64/libc.so.6
      #3 0x00007f368c5aee76 in __assert_fail () from /usr/lib64/libc.so.6
      #4 0x00007f368cc01e5b in sys_mutex_lock (mutex=0x1238ec0) at /home/chug/git/qpid-dispatch/src/posix/threading.c:58
      #5 0x00007f368cc54289 in work_push (hs=0x12e0730, w=...) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:234
      #6 0x00007f368cc54bf3 in connection_wake (qd_conn=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:419
      #7 0x00007f368cc51892 in qd_server_activate (ctx=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/server.c:1520
      #8 0x00007f368cc4a1f7 in CORE_connection_activate (context=0x1319d90, conn=0x7f3670034510) at /home/chug/git/qpid-dispatch/src/router_node.c:1679
      #9 0x00007f368cc2f144 in qdr_activate_connections_CT (core=0x135e460) at /home/chug/git/qpid-dispatch/src/router_core/router_core_thread.c:89
      #10 0x00007f368cc2fa41 in router_core_thread (arg=0x135e460) at /home/chug/git/qpid-dispatch/src/router_core/router_core_thread.c:247
      #11 0x00007f368cc02159 in _thread_init (arg=0x13d1a20) at /home/chug/git/qpid-dispatch/src/posix/threading.c:172
      #12 0x00007f368cb05432 in start_thread () from /usr/lib64/libpthread.so.0
      #13 0x00007f368c67b913 in clone () from /usr/lib64/libc.so.6
      
       
      
      (gdb) thread apply all bt
      
      Thread 2 (Thread 0x7f368bd882c0 (LWP 1140630)):
      #0 0x00007f368cb56c89 in pn_session_get_context (session=0x7f36700f1dc0) at /home/chug/git/qpid-proton/c/src/core/engine.c:297
      #1 0x00007f368cbe23aa in qd_session_from_pn (pn_ssn=0x7f36700f1dc0) at /home/chug/git/qpid-dispatch/include/qpid/dispatch/container.h:255
      #2 0x00007f368cbe5f88 in qd_session_cleanup (qd_conn=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/container.c:1217
      #3 0x00007f368cbe331b in close_handler (container=0x1316d60, conn=0x7f3670090f90, qd_conn=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/container.c:373
      #4 0x00007f368cbe46d1 in qd_container_handle_event (container=0x1316d60, event=0x12cebd0, conn=0x7f3670090f90, qd_conn=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/container.c:751
      #5 0x00007f368cc50333 in handle (qd_server=0x12dca20, e=0x12cebd0, pn_conn=0x7f3670090f90, ctx=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/server.c:1096
      #6 0x00007f368cc52479 in qd_connection_handle (c=0x7f3670018910, e=0x12cebd0) at /home/chug/git/qpid-dispatch/src/server.c:1778
      #7 0x00007f368cc54157 in handle_events (c=0x7f367003b670) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:179
      #8 0x00007f368cc5604b in callback_amqpws (wsi=0x7f367001b290, reason=LWS_CALLBACK_CLOSED, user=0x7f367003b670, in=0x0, len=0) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:880
      #9 0x00007f368c75ed8e in __lws_close_free_wsi.part.0 () from /usr/lib64/libwebsockets.so.15
      #10 0x00007f368c75a379 in lws_context_destroy () from /usr/lib64/libwebsockets.so.15
      #11 0x00007f368cc563c0 in qd_http_server_free (hs=0x12e0730) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:954
      #12 0x00007f368cbe72eb in qd_dispatch_free (qd=0x1161610) at /home/chug/git/qpid-dispatch/src/dispatch.c:368
      #13 0x0000000000402626 in main_process (config_path=0x7fff1c15a7f3 "INTA.conf", python_pkgdir=0x404283 "/usr/lib/qpid-dispatch/python", test_hooks=false, fd=2) at /home/chug/git/qpid-dispatch/router/src/main.c:119
      #14 0x00000000004030cf in main (argc=3, argv=0x7fff1c1593f8) at /home/chug/git/qpid-dispatch/router/src/main.c:369
      
      Thread 1 (Thread 0x7f367e5df700 (LWP 1140659)):
      #0 0x00007f368c5b69e5 in raise () from /usr/lib64/libc.so.6
      #1 0x00007f368c59f895 in abort () from /usr/lib64/libc.so.6
      #2 0x00007f368c59f769 in __assert_fail_base.cold () from /usr/lib64/libc.so.6
      #3 0x00007f368c5aee76 in __assert_fail () from /usr/lib64/libc.so.6
      #4 0x00007f368cc01e5b in sys_mutex_lock (mutex=0x1238ec0) at /home/chug/git/qpid-dispatch/src/posix/threading.c:58
      #5 0x00007f368cc54289 in work_push (hs=0x12e0730, w=...) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:234
      #6 0x00007f368cc54bf3 in connection_wake (qd_conn=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/http-libwebsockets.c:419
      #7 0x00007f368cc51892 in qd_server_activate (ctx=0x7f3670018910) at /home/chug/git/qpid-dispatch/src/server.c:1520
      #8 0x00007f368cc4a1f7 in CORE_connection_activate (context=0x1319d90, conn=0x7f3670034510) at /home/chug/git/qpid-dispatch/src/router_node.c:1679
      #9 0x00007f368cc2f144 in qdr_activate_connections_CT (core=0x135e460) at /home/chug/git/qpid-dispatch/src/router_core/router_core_thread.c:89
      #10 0x00007f368cc2fa41 in router_core_thread (arg=0x135e460) at /home/chug/git/qpid-dispatch/src/router_core/router_core_thread.c:247
      #11 0x00007f368cc02159 in _thread_init (arg=0x13d1a20) at /home/chug/git/qpid-dispatch/src/posix/threading.c:172
      #12 0x00007f368cb05432 in start_thread () from /usr/lib64/libpthread.so.0
      #13 0x00007f368c67b913 in clone () from /usr/lib64/libc.so.6
      (gdb)
      
       

      Attachments

        Activity

          People

            eallen Ernest Allen
            chug Charles E. Rolke
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: