Uploaded image for project: 'Qpid Dispatch'
  1. Qpid Dispatch
  2. DISPATCH-1738

system_tests_multicast failing on Ubuntu Focal

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.13.0
    • Fix Version/s: 1.13.0
    • Component/s: None
    • Labels:

      Description

      https://travis-ci.com/github/jiridanek/qpid-dispatch/jobs/367289452#L17809

      It is the current master at 97ac13417d77cd2f8a90acb837747abee438ed20 with some commits on top which should in no way influence the results of the test.

      This failure happens rarely.

      test 61
            Start 61: system_tests_multicast
      61: Test command: /usr/bin/python "/home/travis/build/jiridanek/qpid-dispatch/build/tests/run.py" "-m" "unittest" "-v" "system_tests_multicast"
      61: Test timeout computed to be: 600
      61: test_01_presettled_large_msg_rx_detach (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_02_presettled_large_msg_rx_close (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_10_unsettled_large_msg_rx_detach (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_11_unsettled_large_msg_rx_close (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_50_presettled (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_51_presettled_mixed_large_msg (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_52_presettled_large_msg (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_60_unsettled_3ack (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_61_unsettled_3ack_large_msg (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_63_unsettled_3ack_outcomes (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_70_unsettled_1ack (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_71_unsettled_1ack_large_msg (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_80_unsettled_3ack_message_annotations (system_tests_multicast.MulticastLinearTest) ... ok
      61: test_90_credit_no_subscribers (system_tests_multicast.MulticastLinearTest)
      61: Verify that multicast senders are blocked until a consumer is present. ... ok
      61: test_91_anonymous_sender (system_tests_multicast.MulticastLinearTest)
      61: Verify that senders over anonymous links do not block waiting for ... ok
      61: test_999_check_for_leaks (system_tests_multicast.MulticastLinearTest) ... ok
      61: 
      61: Router INT.B output file:
      61: >>>>
      61: =================================================================
      61: ==16721==ERROR: AddressSanitizer: heap-use-after-free on address 0x602000001350 at pc 0x00000042f0b9 bp 0x7f6e6c011240 sp 0x7f6e6c010a00
      61: READ of size 2 at 0x602000001350 thread T1
      61:     #0 0x42f0b8 in strlen (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x42f0b8)
      61:     #1 0x7f6e71959999 in qd_compose_insert_string /home/travis/build/jiridanek/qpid-dispatch/src/compose.c:445:50
      61:     #2 0x7f6e71b09589 in qcm_mobile_sync_compose_differential_mau /home/travis/build/jiridanek/qpid-dispatch/src/router_core/modules/mobile_sync/mobile.c:233:5
      61:     #3 0x7f6e71b09589 in qcm_mobile_sync_on_timer_CT /home/travis/build/jiridanek/qpid-dispatch/src/router_core/modules/mobile_sync/mobile.c:389:25
      61:     #4 0x7f6e71ad0cbd in qdr_process_tick_CT /home/travis/build/jiridanek/qpid-dispatch/src/router_core/core_timer.c:123:13
      61:     #5 0x7f6e71aab761 in router_core_thread /home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:193:13
      61:     #6 0x7f6e716f7608 in start_thread (/lib/x86_64-linux-gnu/libpthread.so.0+0x9608)
      61:     #7 0x7f6e70f53102 in clone (/lib/x86_64-linux-gnu/libc.so.6+0x122102)
      61: 
      61: 0x602000001350 is located 0 bytes inside of 6-byte region [0x602000001350,0x602000001356)
      61: freed by thread T0 here:
      61:     #0 0x49494d in free (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x49494d)
      61:     #1 0x7f6e71981cb2 in qd_dispatch_set_router_id /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:345:9
      61:     #2 0x7f6e7198171d in qd_dispatch_free /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:361:5
      61:     #3 0x4c5db2 in main_process /home/travis/build/jiridanek/qpid-dispatch/router/src/main.c:117:5
      61:     #4 0x4c4a3a in main /home/travis/build/jiridanek/qpid-dispatch/router/src/main.c:367:9
      61:     #5 0x7f6e70e580b2 in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x270b2)
      61: 
      61: previously allocated by thread T0 here:
      61:     #0 0x480f74 in strdup (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x480f74)
      61:     #1 0x7f6e71b40a71 in py_string_2_c /home/travis/build/jiridanek/qpid-dispatch/src/python_utils.c:35:19
      61:     #2 0x7f6e71984724 in qd_entity_get_string /home/travis/build/jiridanek/qpid-dispatch/src/entity.c:49:17
      61:     #3 0x7f6e71982548 in qd_dispatch_configure_router /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:195:35
      61:     #4 0x7f6e6da58ff4  (/lib/x86_64-linux-gnu/libffi.so.7+0x6ff4)
      61: LLVMSymbolizer: error reading file: No such file or directory
      61:     #5 0x7ffd7def965f  ([stack]+0x1d65f)
      61: 
      61: Thread T1 created by T0 here:
      61:     #0 0x47f97a in pthread_create (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x47f97a)
      61:     #1 0x7f6e719e5462 in sys_thread /home/travis/build/jiridanek/qpid-dispatch/src/posix/threading.c:181:5
      61:     #2 0x7f6e71a8f6a1 in qdr_core /home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core.c:91:20
      61:     #3 0x7f6e71b14468 in qd_router_setup_late /home/travis/build/jiridanek/qpid-dispatch/src/router_node.c:1969:31
      61:     #4 0x7f6e6da58ff4  (/lib/x86_64-linux-gnu/libffi.so.7+0x6ff4)
      61:     #5 0x7ffd7def9f2f  ([stack]+0x1df2f)
      61: 
      61: SUMMARY: AddressSanitizer: heap-use-after-free (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x42f0b8) in strlen
      61: Shadow bytes around the buggy address:
      61:   0x0c047fff8210: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fd
      61:   0x0c047fff8220: fa fa 00 05 fa fa fd fa fa fa fd fd fa fa 00 04
      61:   0x0c047fff8230: fa fa fd fa fa fa fd fd fa fa 00 02 fa fa fd fa
      61:   0x0c047fff8240: fa fa fd fa fa fa fd fa fa fa 00 00 fa fa fd fd
      61:   0x0c047fff8250: fa fa fd fd fa fa fd fd fa fa fd fd fa fa 00 00
      61: =>0x0c047fff8260: fa fa 00 00 fa fa fd fd fa fa[fd]fa fa fa fd fd
      61:   0x0c047fff8270: fa fa 07 fa fa fa 00 07 fa fa fd fd fa fa fd fd
      61:   0x0c047fff8280: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff8290: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff82a0: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff82b0: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61: Shadow byte legend (one shadow byte represents 8 application bytes):
      61:   Addressable:           00
      61:   Partially addressable: 01 02 03 04 05 06 07 
      61:   Heap left redzone:       fa
      61:   Freed heap region:       fd
      61:   Stack left redzone:      f1
      61:   Stack mid redzone:       f2
      61:   Stack right redzone:     f3
      61:   Stack after return:      f5
      61:   Stack use after scope:   f8
      61:   Global redzone:          f9
      61:   Global init order:       f6
      61:   Poisoned by user:        f7
      61:   Container overflow:      fc
      61:   Array cookie:            ac
      61:   Intra object redzone:    bb
      61:   ASan internal:           fe
      61:   Left alloca redzone:     ca
      61:   Right alloca redzone:    cb
      61:   Shadow gap:              cc
      61: ==16721==ABORTING
      61: 
      61: <<<<
      61: 
      61: Router INT.B command file:
      61: >>>>
      61: qdrouterd -c INT.B.conf -I /home/travis/build/jiridanek/qpid-dispatch/python
      61: pid=16721
      61: 
      61: <<<<
      61: 
      61: Router INT.B log file tail:
      61: >>>>
      61: 2020-08-01 06:38:59.412282 +0000 ROUTER_CORE (debug) Delivery decref:    dlv:615000044cd0 rc:2 link:2 removed reference from pn_delivery (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:147)
      61: 2020-08-01 06:38:59.412303 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:615000012550 rc:3 link:2 qdr_delivery_update_disposition - add to action list (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.412314 +0000 ROUTER_CORE (debug) Delivery decref:    dlv:615000012550 rc:2 link:2 removed reference from pn_delivery (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:147)
      61: 2020-08-01 06:38:59.412348 +0000 ROUTER_CORE (trace) Core action 'link_deliver' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.412422 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:615000044cd0 rc:1 link:2 qdr_link_forward_CT - removed from action (2) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.412434 +0000 ROUTER_CORE (trace) Core action 'link_deliver' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.412721 +0000 PROTOCOL (trace) [1]:FRAME: 0 <- @transfer(20) [handle=0, delivery-id=144, delivery-tag=b"V\x07\x00\x00\x00\x00\x00\x00", message-format=0, settled=true] (260) "\x00Sp\xd0\x00\x00\x00\x05\x00\x00\x00\x01B\x00Sr\xd1\x00\x00\x00]\x00\x00\x00\x08\xa3\x0ex-opt-qd.trace\xd0\x00\x00\x00\x0d\x00\x00\x00\x01\xa1\x070/INT.A\xa3\x10x-opt-qd.ingress\xa1\x070/INT.A\xa3\x09x-opt-qd.\xa1\x01X\xa3\x09x-opt-qd.\xa1\x01X\x00Ss\xd0\x00\x00\x00%\x00\x00\x00\x06@@\xa1\x1aamqp:/_topo/0/all/qdrouter@@@\x00St\xd1\x00\x00\x00\x10\x00\x00\x00\x02\xa1\x06opcode\xa1\x02RA\x00Sw\xd1\x00\x00\x00E\x00\x00\x00\x0c\xa1\x02id\xa1\x05INT.A\xa1\x02pvT\x01\xa1\x04area\xa1\x010\xa1\x08instanceq_%\x0d\xd1\xa1\x06ls_seqT\x01\xa1\x0amobile_seqT-" (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.412931 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:61500000c650 rc:1 link:2 qdr_link_deliver_to - newly created delivery, add to action list (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.412949 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:61500000c650 rc:2 link:2 qdr_link_deliver_to - protect returned value (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.412966 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:61500000c650 rc:3 link:2 referenced by a pn_delivery (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.412977 +0000 ROUTER_CORE (debug) Delivery decref:    dlv:61500000c650 rc:2 link:2 release protection of return from deliver (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:147)
      61: 2020-08-01 06:38:59.412995 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:61500000c650 rc:3 link:2 qdr_delivery_update_disposition - add to action list (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.413007 +0000 ROUTER_CORE (debug) Delivery decref:    dlv:61500000c650 rc:2 link:2 removed reference from pn_delivery (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:147)
      61: 2020-08-01 06:38:59.413495 +0000 ROUTER_HELLO (trace) RCVD: HELLO(id=INT.A pv=1 area=0 inst=1596263889 seen=['INT.B']) (/home/travis/build/jiridanek/qpid-dispatch/python/qpid_dispatch_internal/router/engine.py:150)
      61: 2020-08-01 06:38:59.413803 +0000 ROUTER_MA (debug) Received MAU (differential) from INT.A, mobile_seq=45 (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/modules/mobile_sync/mobile.c:546)
      61: 2020-08-01 06:38:59.413896 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:615000012550 rc:1 link:2 qdr_link_forward_CT - removed from action (2) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.413917 +0000 ROUTER_CORE (trace) Core action 'update_delivery' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.413931 +0000 ROUTER_CORE (trace) Remote updated mcast delivery (0x615000044cd0) disp=0x0 settled=True (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:798)
      61: 2020-08-01 06:38:59.413946 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:615000044cd0 rc:0 link:2 qdr_update_delivery_CT - remove from action (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.413966 +0000 ROUTER_CORE (debug) Delivery outcome for pre-settled: dlv:615000044cd0 link:2 is unknown (0x0) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:394)
      61: 2020-08-01 06:38:59.413982 +0000 ROUTER_CORE (trace) Core action 'update_delivery' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.414001 +0000 ROUTER_CORE (trace) Remote updated mcast delivery (0x615000012550) disp=0x0 settled=True (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:798)
      61: 2020-08-01 06:38:59.414024 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:615000012550 rc:0 link:2 qdr_update_delivery_CT - remove from action (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.414042 +0000 ROUTER_CORE (debug) Delivery outcome for pre-settled: dlv:615000012550 link:2 is unknown (0x0) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:394)
      61: 2020-08-01 06:38:59.414064 +0000 ROUTER_CORE (trace) Core action 'link_deliver' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.414116 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:61500000c650 rc:1 link:2 qdr_link_forward_CT - removed from action (2) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.414128 +0000 ROUTER_CORE (trace) Core action 'update_delivery' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.414140 +0000 ROUTER_CORE (trace) Remote updated mcast delivery (0x61500000c650) disp=0x0 settled=True (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:798)
      61: 2020-08-01 06:38:59.414152 +0000 ROUTER_CORE (debug) Delivery decref_CT:  dlv:61500000c650 rc:0 link:2 qdr_update_delivery_CT - remove from action (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:637)
      61: 2020-08-01 06:38:59.414169 +0000 ROUTER_CORE (debug) Delivery outcome for pre-settled: dlv:61500000c650 link:2 is unknown (0x0) (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:394)
      61: 2020-08-01 06:38:59.414643 +0000 ROUTER_LS (trace) RCVD: RA(id=INT.A pv=1 area=0 inst=1596263889 ls_seq=1 mobile_seq=45) (/home/travis/build/jiridanek/qpid-dispatch/python/qpid_dispatch_internal/router/engine.py:155)
      61: 2020-08-01 06:38:59.414731 +0000 PROTOCOL (trace) [1]:FRAME: 0 -> @flow(19) [next-incoming-id=145, incoming-window=2147483647, next-outgoing-id=140, outgoing-window=2147483647, handle=0, delivery-count=145, link-credit=250, drain=false] (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524025 +0000 PROTOCOL (trace) [4]:FRAME: 0 <- @flow(19) [next-incoming-id=56, incoming-window=2147483647, next-outgoing-id=56, outgoing-window=2147483647, handle=1, delivery-count=56, link-credit=1, drain=false] (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524099 +0000 PROTOCOL (trace) [4]:FRAME: 0 <- @close(24) [] (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524125 +0000 PROTOCOL (trace) [4]:FRAME:   <- EOS (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524244 +0000 ROUTER_CORE (trace) Core action 'link_flow' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.524279 +0000 ROUTER_CORE (trace) Core action 'link_detach' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.524309 +0000 ROUTER_CORE (info) [C4][L24] Link lost: del=56 presett=0 psdrop=0 acc=56 rej=0 rel=0 mod=0 delay1=0 delay10=0 blocked=no (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/connections.c:1036)
      61: 2020-08-01 06:38:59.524376 +0000 PROTOCOL (trace) [4]:FRAME: 0 -> @close(24) [] (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524438 +0000 PROTOCOL (trace) [4]:FRAME:   -> EOS (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:112)
      61: 2020-08-01 06:38:59.524626 +0000 ROUTER_CORE (trace) Core action 'link_detach' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.524663 +0000 ROUTER_CORE (info) [C4][L25] Link lost: del=56 presett=56 psdrop=0 acc=0 rej=0 rel=0 mod=0 delay1=0 delay10=0 blocked=no (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/connections.c:1036)
      61: 2020-08-01 06:38:59.524700 +0000 ROUTER_CORE (trace) Core action 'connection_closed' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.524715 +0000 ROUTER_CORE (info) [C4] Connection Closed (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/connections.c:1506)
      61: 2020-08-01 06:38:59.526349 +0000 ROUTER_CORE (trace) Core action 'send_to' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.526438 +0000 ROUTER_CORE (debug) Delivery incref:    dlv:61500000c650 rc:1 link:3 qdr_forward_deliver_CT - add to undelivered list (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/delivery.c:115)
      61: 2020-08-01 06:38:59.526492 +0000 ROUTER_HELLO (trace) SENT: HELLO(id=INT.B pv=1 area=0 inst=1596263889 seen=['INT.A']) (/home/travis/build/jiridanek/qpid-dispatch/python/qpid_dispatch_internal/router/hello.py:54)
      61: 2020-08-01 06:38:59.526574 +0000 ROUTER_CORE (trace) Core action 'process_tick' (/home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:192)
      61: 2020-08-01 06:38:59.526618 +0000 SERVER (notice) Shut Down (/home/travis/build/jiridanek/qpid-dispatch/src/server.c:1421)
      61: 2020-08-01 06:38:59.526780 +0000 CONTAINER (trace) Default node removed (/home/travis/build/jiridanek/qpid-dispatch/src/container.c:848)
      61: 
      61: <<<<
      61: ERROR
      61: 
      61: ======================================================================
      61: ERROR: tearDownClass (system_tests_multicast.MulticastLinearTest)
      61: ----------------------------------------------------------------------
      61: Traceback (most recent call last):
      61:   File "/home/travis/build/jiridanek/qpid-dispatch/tests/system_test.py", line 773, in tearDownClass
      61:     cls.tester.teardown()
      61:   File "/home/travis/build/jiridanek/qpid-dispatch/tests/system_test.py", line 719, in teardown
      61:     raise RuntimeError("Errors during teardown: \n\n%s" % "\n\n".join([str(e) for e in errors]))
      61: RuntimeError: Errors during teardown: 
      61: 
      61: Process 16721 error: exit code 1, expected 0
      61: qdrouterd -c INT.B.conf -I /home/travis/build/jiridanek/qpid-dispatch/python
      61: /home/travis/build/jiridanek/qpid-dispatch/build/tests/system_test.dir/system_tests_multicast/MulticastLinearTest/setUpClass/INT.B-2.cmd
      61: >>>>
      61: =================================================================
      61: ==16721==ERROR: AddressSanitizer: heap-use-after-free on address 0x602000001350 at pc 0x00000042f0b9 bp 0x7f6e6c011240 sp 0x7f6e6c010a00
      61: READ of size 2 at 0x602000001350 thread T1
      61:     #0 0x42f0b8 in strlen (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x42f0b8)
      61:     #1 0x7f6e71959999 in qd_compose_insert_string /home/travis/build/jiridanek/qpid-dispatch/src/compose.c:445:50
      61:     #2 0x7f6e71b09589 in qcm_mobile_sync_compose_differential_mau /home/travis/build/jiridanek/qpid-dispatch/src/router_core/modules/mobile_sync/mobile.c:233:5
      61:     #3 0x7f6e71b09589 in qcm_mobile_sync_on_timer_CT /home/travis/build/jiridanek/qpid-dispatch/src/router_core/modules/mobile_sync/mobile.c:389:25
      61:     #4 0x7f6e71ad0cbd in qdr_process_tick_CT /home/travis/build/jiridanek/qpid-dispatch/src/router_core/core_timer.c:123:13
      61:     #5 0x7f6e71aab761 in router_core_thread /home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core_thread.c:193:13
      61:     #6 0x7f6e716f7608 in start_thread (/lib/x86_64-linux-gnu/libpthread.so.0+0x9608)
      61:     #7 0x7f6e70f53102 in clone (/lib/x86_64-linux-gnu/libc.so.6+0x122102)
      61: 
      61: 0x602000001350 is located 0 bytes inside of 6-byte region [0x602000001350,0x602000001356)
      61: freed by thread T0 here:
      61:     #0 0x49494d in free (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x49494d)
      61:     #1 0x7f6e71981cb2 in qd_dispatch_set_router_id /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:345:9
      61:     #2 0x7f6e7198171d in qd_dispatch_free /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:361:5
      61:     #3 0x4c5db2 in main_process /home/travis/build/jiridanek/qpid-dispatch/router/src/main.c:117:5
      61:     #4 0x4c4a3a in main /home/travis/build/jiridanek/qpid-dispatch/router/src/main.c:367:9
      61:     #5 0x7f6e70e580b2 in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x270b2)
      61: 
      61: previously allocated by thread T0 here:
      61:     #0 0x480f74 in strdup (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x480f74)
      61:     #1 0x7f6e71b40a71 in py_string_2_c /home/travis/build/jiridanek/qpid-dispatch/src/python_utils.c:35:19
      61:     #2 0x7f6e71984724 in qd_entity_get_string /home/travis/build/jiridanek/qpid-dispatch/src/entity.c:49:17
      61:     #3 0x7f6e71982548 in qd_dispatch_configure_router /home/travis/build/jiridanek/qpid-dispatch/src/dispatch.c:195:35
      61:     #4 0x7f6e6da58ff4  (/lib/x86_64-linux-gnu/libffi.so.7+0x6ff4)
      61: LLVMSymbolizer: error reading file: No such file or directory
      61:     #5 0x7ffd7def965f  ([stack]+0x1d65f)
      61: 
      61: Thread T1 created by T0 here:
      61:     #0 0x47f97a in pthread_create (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x47f97a)
      61:     #1 0x7f6e719e5462 in sys_thread /home/travis/build/jiridanek/qpid-dispatch/src/posix/threading.c:181:5
      61:     #2 0x7f6e71a8f6a1 in qdr_core /home/travis/build/jiridanek/qpid-dispatch/src/router_core/router_core.c:91:20
      61:     #3 0x7f6e71b14468 in qd_router_setup_late /home/travis/build/jiridanek/qpid-dispatch/src/router_node.c:1969:31
      61:     #4 0x7f6e6da58ff4  (/lib/x86_64-linux-gnu/libffi.so.7+0x6ff4)
      61:     #5 0x7ffd7def9f2f  ([stack]+0x1df2f)
      61: 
      61: SUMMARY: AddressSanitizer: heap-use-after-free (/home/travis/build/jiridanek/qpid-dispatch/build/router/qdrouterd+0x42f0b8) in strlen
      61: Shadow bytes around the buggy address:
      61:   0x0c047fff8210: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fd
      61:   0x0c047fff8220: fa fa 00 05 fa fa fd fa fa fa fd fd fa fa 00 04
      61:   0x0c047fff8230: fa fa fd fa fa fa fd fd fa fa 00 02 fa fa fd fa
      61:   0x0c047fff8240: fa fa fd fa fa fa fd fa fa fa 00 00 fa fa fd fd
      61:   0x0c047fff8250: fa fa fd fd fa fa fd fd fa fa fd fd fa fa 00 00
      61: =>0x0c047fff8260: fa fa 00 00 fa fa fd fd fa fa[fd]fa fa fa fd fd
      61:   0x0c047fff8270: fa fa 07 fa fa fa 00 07 fa fa fd fd fa fa fd fd
      61:   0x0c047fff8280: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff8290: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff82a0: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61:   0x0c047fff82b0: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
      61: Shadow byte legend (one shadow byte represents 8 application bytes):
      61:   Addressable:           00
      61:   Partially addressable: 01 02 03 04 05 06 07 
      61:   Heap left redzone:       fa
      61:   Freed heap region:       fd
      61:   Stack left redzone:      f1
      61:   Stack mid redzone:       f2
      61:   Stack right redzone:     f3
      61:   Stack after return:      f5
      61:   Stack use after scope:   f8
      61:   Global redzone:          f9
      61:   Global init order:       f6
      61:   Poisoned by user:        f7
      61:   Container overflow:      fc
      61:   Array cookie:            ac
      61:   Intra object redzone:    bb
      61:   ASan internal:           fe
      61:   Left alloca redzone:     ca
      61:   Right alloca redzone:    cb
      61:   Shadow gap:              cc
      61: ==16721==ABORTING
      61: <<<<
      61: 
      61: ----------------------------------------------------------------------
      61: Ran 16 tests in 50.432s
      61: 
      61: FAILED (errors=1)
      61/69 Test #61: system_tests_multicast ............................***Failed   50.57 sec
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gmurthy Ganesh Murthy
                Reporter:
                jdanek Jiri Daněk
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: