Uploaded image for project: 'Qpid Dispatch'
  1. Qpid Dispatch
  2. DISPATCH-1526

Local temp address credit growing unpectedly, edge and interior

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.11.0
    • Router Node
    • None
    • Fedora 28. Two hosts: half the routers running python2.7 and half running python 3.7

    Description

      • Running 12-node setup: 4 interior routers in a line, each with two edge routers attached.
      • Inject a few million messages into an edge router with receivers placed throughout the network.

      After a while some link credit values have grown unreasonably.

      Dispatch 1.10-rc2, rolke's 12-router network
      After running a few million unsettled multicast through some thousands of connectionsA few looks at EB2:
        * One link has 72K in the delay column. ???
      One look at INTD:
        * One temp link has credit of 78K > qdstat -l -b amqp://$EB2_normal
      2019-12-16 20:11:10.602222 UTC
      EB2Router Links
        type      dir  conn id  id      peer  class   addr                  phs  cap  pri  undel  unsett  deliv  presett  psdrop  acc  rej  rel  mod  delay  rate  stuck  cred   blkd
        ===============================================================================================================================================================================
        endpoint  out  1        9             local   _edge                      250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        10                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        11                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      32     -
        endpoint  out  1        12                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        13                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      100    -
        endpoint  out  1        14                                               250  0    0      0       75730  75730    0       0    0    0    0    75730  0     0      1      -
        endpoint  in   1        15                                               250  0    0      0       75730  75730    0       0    0    0    0    0      0     0      74770  -
        endpoint  out  75729    151470        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      10     -
        endpoint  in   1        151471        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   75731    151474        mobile  $management           0    250  0    0      0       2      0        0       2    0    0    0    0      0     0      250    -
        endpoint  out  75731    151475        local   temp.HNjvLBWfHt70T2j       250  0    0      0       1      1        0       0    0    0    0    0      0     0      1      - > qdstat -l -b amqp://$EB2_normal
      2019-12-16 20:11:18.164060 UTC
      EB2Router Links
        type      dir  conn id  id      peer  class   addr                  phs  cap  pri  undel  unsett  deliv  presett  psdrop  acc  rej  rel  mod  delay  rate  stuck  cred   blkd
        ===============================================================================================================================================================================
        endpoint  out  1        9             local   _edge                      250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        10                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        11                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      32     -
        endpoint  out  1        12                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        13                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      100    -
        endpoint  out  1        14                                               250  0    0      0       75731  75731    0       0    0    0    0    75731  0     0      1      -
        endpoint  in   1        15                                               250  0    0      0       75731  75731    0       0    0    0    0    0      0     0      74769  -
        endpoint  out  75729    151470        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      10     -
        endpoint  in   1        151471        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   75732    151476        mobile  $management           0    250  0    0      0       2      0        0       2    0    0    0    0      0     0      250    -
        endpoint  out  75732    151477        local   temp.Nl+IGH8UhEW+1zU       250  0    0      0       1      1        0       0    0    0    0    0      0     0      1      - > qdstat -l -b amqp://$EB2_normal
      2019-12-16 20:11:29.071773 UTC
      EB2Router Links
        type      dir  conn id  id      peer  class   addr                  phs  cap  pri  undel  unsett  deliv  presett  psdrop  acc  rej  rel  mod  delay  rate  stuck  cred   blkd
        ===============================================================================================================================================================================
        endpoint  out  1        9             local   _edge                      250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        10                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        11                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      32     -
        endpoint  out  1        12                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   1        13                                               250  0    0      0       0      0        0       0    0    0    0    0      0     0      100    -
        endpoint  out  1        14                                               250  0    0      0       75732  75732    0       0    0    0    0    75732  0     0      1      -
        endpoint  in   1        15                                               250  0    0      0       75732  75732    0       0    0    0    0    0      0     0      74768  -
        endpoint  out  75729    151470        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      10     -
        endpoint  in   1        151471        mobile  multicast/q1          0    250  0    0      0       0      0        0       0    0    0    0    0      0     0      250    -
        endpoint  in   75733    151478        mobile  $management           0    250  0    0      0       2      0        0       2    0    0    0    0      0     0      250    -
        endpoint  out  75733    151479        local   temp.tNBIGbW2M9QjiyJ       250  0    0      0       1      1        0       0    0    0    0    0      0     0      1      - > qdstat -l -b amqp://$INTD_normal
      2019-12-16 20:11:36.407769 UTC
      INTDRouter Links
        type            dir  conn id  id     peer  class   addr                     phs  cap  pri  undel  unsett  deliv     presett  psdrop  acc     rej  rel       mod      delay  rate  stuck  cred   blkd
        ======================================================================================================================================================================================================
        endpoint        in   2        9                                                  250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        edge-downlink   out  2        10           edge    ED2                           250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        out  2        11           mobile  _$qd.edge_addr_tracking  0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      32     -
        endpoint        in   2        12           mobile  $management              0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        out  2        13           local   temp.GTtfXLohcrP7J9s          250  0    0      0       0         0        0       0       0    0         0        0      0     0      100    -
        endpoint        in   2        14           mobile  _$qd.addr_lookup         0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      1      -
        endpoint        out  2        15           local   temp.m1hS68v3b1M6B7V          250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        router-control  in   1        16                                                 250  0    0      0       18654     18654    0       0       0    0         0        0      1     0      250    -
        router-control  out  1        17           local   qdhello                       250  0    0      0       15555     15555    0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        18                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        19                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        20                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        21                                                 250  1    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        22                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        23                                                 250  2    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        24                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        25                                                 250  3    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        26                                                 250  0    0      0       14275922  0        0       464894  0    10033683  3777345  0      2     0      250    -
        inter-router    out  1        27                                                 250  4    0      0       30444     30444    0       0       0    0         0        0      2     0      250    -
        inter-router    in   1        28                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        29                                                 250  5    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        30                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        31                                                 250  6    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        32                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        33                                                 250  7    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        34                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        35                                                 250  8    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    in   1        36                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        inter-router    out  1        37                                                 250  9    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        in   3        38                                                 250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        edge-downlink   out  3        39           edge    ED1                           250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        out  3        40           mobile  _$qd.edge_addr_tracking  0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      32     -
        endpoint        in   3        41           mobile  $management              0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        out  3        42           local   temp.jSR2sg7CTVLXEaK          250  0    0      0       0         0        0       0       0    0         0        0      0     0      100    -
        endpoint        in   3        43           mobile  _$qd.addr_lookup         0    250  0    0      0       79054     79054    0       0       0    0         0        0      0     0      1      -
        endpoint        out  3        44           local   temp.ckzi8UNhT5qQe4i          250  0    0      0       79054     79054    0       0       0    0         0        0      0     0      77946  -
        endpoint        out  3        79154        mobile  multicast/q1             0    250  0    0      0       0         0        0       0       0    0         0        0      0     0      250    -
        endpoint        in   32       79155        mobile  $management              0    250  0    0      0       2         0        0       2       0    0         0        0      0     0      250    -
        endpoint        out  32       79156        local   temp.XYYPigubCz0IMxD          250  0    0      0       1         1        0       0       0    0         0        0      0     0      1      -
       

      Attachments

        Issue Links

          Activity

            People

              kgiusti Ken Giusti
              chug Charles E. Rolke
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: