Traffic Server
  1. Traffic Server
  2. TS-1178

cop will kill manager & server, even cop it self

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.4
    • Fix Version/s: 3.1.4
    • Component/s: Manager
    • Labels:
      None
    • Environment:

      git master on RHEL6.1 x86_64

      Description

      [root@test58 trafficserver]# cat /tmp/traffic_cop.trace 
      <1333239680.0000> [DEBUG]: Entering init()
      <1333239680.0000> [DEBUG]: Entering init_signals()
      <1333239680.0000> [DEBUG]: Entering set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving init_signals()
      <1333239680.0000> [DEBUG]: Entering init_config_dir()
      <1333239680.0000> [DEBUG]: Leaving init_config_dir()
      <1333239680.0000> [DEBUG]: Entering init_config_file()
      <1333239680.0000> [DEBUG]: Leaving init_config_file()
      <1333239680.0000> [DEBUG]: Entering init_lockfiles()
      <1333239680.0000> [DEBUG]: Leaving init_lockfiles()
      <1333239680.0000> [DEBUG]: Entering check_lockfile()
      <1333239680.0000> [unknown]: --- Cop Starting [Version: Apache Traffic Server - traffic_cop - 3.1.4-unstable - (build # 310 on Apr  1 2012 at 00:34:30)] ---
      <1333239680.0000> [DEBUG]: Leaving check_lockfile()
      <1333239680.0000> [DEBUG]: Leaving init()
      <1333239680.0000> [DEBUG]: Entering check()
      <1333239680.0000> [DEBUG]: Entering check_no_run()
      <1333239680.0000> [DEBUG]: Entering transient_error(2, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(2, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving check_no_run() --> 0
      <1333239680.0000> [DEBUG]: Entering read_config()
      <1333239680.0000> [DEBUG]: Entering build_config_table(33932704)
      <1333239680.0000> [DEBUG]: Leaving build_config_table(33932704)
      <1333239680.0000> [DEBUG]: Entering process_syslog_config()
      <1333239680.0000> [DEBUG]: Leaving process_syslog_config()
      <1333239680.0000> [DEBUG]: Leaving read_config()
      <1333239680.0000> [DEBUG]: Entering check_programs()
      <1333239680.0000> [DEBUG]: Entering heartbeat_manager()
      <1333239680.0000> [WARNING]: (cli test) unable to retrieve manager_binary
      <1333239680.0000> [WARNING]: manager heartbeat [variable] failed [1]
      <1333239680.0000> [DEBUG]: Leaving heartbeat_manager() --> -1
      <1333239680.0000> [DEBUG]: Entering check_memory()
      <1333239680.0000> [DEBUG]: Leaving check_memory()
      <1333239680.0000> [DEBUG]: Entering millisleep(10000)
      <1333239680.0000> [DEBUG]: Leaving millisleep(10000)
      <1333239680.0000> [DEBUG]: Entering check_no_run()
      <1333239680.0000> [DEBUG]: Entering transient_error(2, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(2, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving check_no_run() --> 0
      <1333239680.0000> [DEBUG]: Entering read_config()
      <1333239680.0000> [DEBUG]: Entering check_programs()
      <1333239680.0000> [DEBUG]: Entering heartbeat_manager()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering open_socket(8088, (null), (null))
      <1333239680.0000> [DEBUG]: Entering transient_error(115, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(115, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving open_socket(8088, 127.0.0.1, (null)) --> 8
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [WARNING]: (manager test) bad response value
      <1333239680.0000> [WARNING]: manager heartbeat [variable] failed [2]
      <1333239680.0000> [WARNING]: killing manager
      <1333239680.0000> [DEBUG]: Entering safe_kill(/var/run/trafficserver/manager.lock, traffic_manager, 1)
      <1333239680.0000> [DEBUG]: Entering set_alarm_warn()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_warn()
      <1333239680.0000> [DEBUG]: Entering set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving safe_kill(/var/run/trafficserver/manager.lock, traffic_manager, 1)
      <1333239680.0000> [DEBUG]: Leaving heartbeat_manager() --> -1
      <1333239680.0000> [DEBUG]: Entering check_memory()
      <1333239680.0000> [DEBUG]: Leaving check_memory()
      <1333239680.0000> [DEBUG]: Entering millisleep(10000)
      <1333239680.0000> [DEBUG]: Leaving millisleep(10000)
      <1333239680.0000> [DEBUG]: Entering check_no_run()
      <1333239680.0000> [DEBUG]: Entering transient_error(2, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(2, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving check_no_run() --> 0
      <1333239680.0000> [DEBUG]: Entering read_config()
      <1333239680.0000> [DEBUG]: Entering check_programs()
      <1333239680.0000> [WARNING]: traffic_manager not running, making sure traffic_server is dead
      <1333239680.0000> [DEBUG]: Entering safe_kill(/var/run/trafficserver/server.lock, traffic_server, 0)
      <1333239680.0000> [DEBUG]: Entering set_alarm_warn()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_warn()
      <1333239680.0000> [DEBUG]: Entering set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_death()
      <1333239680.0000> [DEBUG]: Leaving safe_kill(/var/run/trafficserver/server.lock, traffic_server, 0)
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [WARNING]: spawning traffic_manager
      <1333239680.0000> [DEBUG]: Entering spawn_manager()
      <1333239680.0000> [DEBUG]: spawn_manager: Launching /usr/bin/traffic_manager with options ''
      <1333239680.0000> [DEBUG]: Leaving spawn_manager()
      <1333239680.0000> [DEBUG]: Leaving check_programs()
      <1333239680.0000> [DEBUG]: Entering check_memory()
      <1333239680.0000> [DEBUG]: Leaving check_memory()
      <1333239680.0000> [DEBUG]: Entering millisleep(10000)
      <1333239680.0000> [DEBUG]: Leaving millisleep(10000)
      <1333239680.0000> [DEBUG]: Entering check_no_run()
      <1333239680.0000> [DEBUG]: Entering transient_error(2, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(2, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving check_no_run() --> 0
      <1333239680.0000> [DEBUG]: Entering read_config()
      <1333239680.0000> [DEBUG]: Entering check_programs()
      <1333239680.0000> [DEBUG]: Entering heartbeat_manager()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering open_socket(8088, (null), (null))
      <1333239680.0000> [DEBUG]: Entering transient_error(115, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(115, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving open_socket(8088, 127.0.0.1, (null)) --> 8
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [WARNING]: (manager test) bad response value
      <1333239680.0000> [WARNING]: manager heartbeat [variable] failed [1]
      <1333239680.0000> [DEBUG]: Leaving heartbeat_manager() --> -1
      <1333239680.0000> [DEBUG]: Entering check_memory()
      <1333239680.0000> [DEBUG]: Leaving check_memory()
      <1333239680.0000> [DEBUG]: Entering millisleep(10000)
      <1333239680.0000> [DEBUG]: Leaving millisleep(10000)
      <1333239680.0000> [DEBUG]: Entering check_no_run()
      <1333239680.0000> [DEBUG]: Entering transient_error(2, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(2, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving check_no_run() --> 0
      <1333239680.0000> [DEBUG]: Entering read_config()
      <1333239680.0000> [DEBUG]: Entering build_config_table(33974976)
      <1333239680.0000> [DEBUG]: Leaving build_config_table(33974976)
      <1333239680.0000> [DEBUG]: Entering process_syslog_config()
      <1333239680.0000> [DEBUG]: Leaving process_syslog_config()
      <1333239680.0000> [DEBUG]: Leaving read_config()
      <1333239680.0000> [DEBUG]: Entering check_programs()
      <1333239680.0000> [DEBUG]: Entering heartbeat_manager()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering open_socket(8088, (null), (null))
      <1333239680.0000> [DEBUG]: Entering transient_error(115, 500)
      <1333239680.0000> [DEBUG]: Leaving transient_error(115, 500) --> false
      <1333239680.0000> [DEBUG]: Leaving open_socket(8088, 127.0.0.1, (null)) --> 8
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [DEBUG]: Entering milliseconds()
      <1333239680.0000> [DEBUG]: Leaving milliseconds()
      <1333239680.0000> [WARNING]: (manager test) bad response value
      <1333239680.0000> [WARNING]: manager heartbeat [variable] failed [2]
      <1333239680.0000> [WARNING]: killing manager
      <1333239680.0000> [DEBUG]: Entering safe_kill(/var/run/trafficserver/manager.lock, traffic_manager, 1)
      <1333239680.0000> [DEBUG]: Entering set_alarm_warn()
      <1333239680.0000> [DEBUG]: Leaving set_alarm_warn()
      

        Activity

        Hide
        Zhao Yongming added a comment -

        let's blame that Igor.

        Show
        Zhao Yongming added a comment - let's blame that Igor.
        Hide
        Zhao Yongming added a comment -

        here is why the strcmp() fail, in test_rs_port():

        (gdb) b TrafficCop.cc:1172
        Breakpoint 1 at 0x404ea0: file TrafficCop.cc, line 1172.
        (gdb) c
        Continuing.
        
        Breakpoint 1, test_rs_port () at TrafficCop.cc:1176
        1176	  if (strcmp(buffer, manager_binary) != 0) {
        (gdb) p buffer
        $1 = "traffic_manager'\n\n\000\000\000\000\000\000\v\000\000\000\000\000\000\000\210\377\377\377\377\377\377\377\060\236b\000\000\000\000\000\240\236֠P\177\000\000\020 \000\000\000\000\000\000\020 \000\000\000\000\000\000@\276b\000\000\000\000\000\020 \000\000\000\000\000\000Cѥ\240P\177\000\000\360\363\375\363\377\177\000\000vP\177\000\000\240\236֠P\177\000\000@\236b\000\000\000\000\000F\000\000\000\000\000\000\000\060\236b\000\000\000\000\000P\000\000\000\000\000\000\000\271襠P\177\000\000\000 \000\000\000\000\000\000\340\233b\000\000\000\000\000\220\364\375\363\377\177\000\000\240\236֠P\177\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\v\000\000\000\000\000\000\000\240\236֠P\177\000\000\024\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\v\000\000\000\000\000\000\000\210"...
        (gdb) p manager_binary
        $2 = "traffic_manager", '\000' <repeats 4080 times>
        (gdb) 
        
        Show
        Zhao Yongming added a comment - here is why the strcmp() fail, in test_rs_port(): (gdb) b TrafficCop.cc:1172 Breakpoint 1 at 0x404ea0: file TrafficCop.cc, line 1172. (gdb) c Continuing. Breakpoint 1, test_rs_port () at TrafficCop.cc:1176 1176 if (strcmp(buffer, manager_binary) != 0) { (gdb) p buffer $1 = "traffic_manager'\n\n\000\000\000\000\000\000\v\000\000\000\000\000\000\000\210\377\377\377\377\377\377\377\060\236b\000\000\000\000\000\240\236֠P\177\000\000\020 \000\000\000\000\000\000\020 \000\000\000\000\000\000@\276b\000\000\000\000\000\020 \000\000\000\000\000\000Cѥ\240P\177\000\000\360\363\375\363\377\177\000\000vP\177\000\000\240\236֠P\177\000\000@\236b\000\000\000\000\000F\000\000\000\000\000\000\000\060\236b\000\000\000\000\000P\000\000\000\000\000\000\000\271襠P\177\000\000\000 \000\000\000\000\000\000\340\233b\000\000\000\000\000\220\364\375\363\377\177\000\000\240\236֠P\177\000\000\000\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\v\000\000\000\000\000\000\000\240\236֠P\177\000\000\024\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\v\000\000\000\000\000\000\000\210" ... (gdb) p manager_binary $2 = "traffic_manager" , '\000' <repeats 4080 times> (gdb)
        Hide
        Zhao Yongming added a comment -

        this issue is related to the cluster mode 1, and it is triggered in:

        static int
        heartbeat_manager()
        {
          int err;
        
        #ifdef TRACE_LOG_COP
          cop_log(COP_DEBUG, "Entering heartbeat_manager()\n");
        #endif
          // the CLI, and the rsport if cluster is enabled.
          err = test_mgmt_cli_port();
          if ((0 == err) && (cluster_type != NO_CLUSTER))
            err = test_rs_port();
        

        here is the tcpdump on port 8088:

        [root@test58 ~]# tcpdump -n -i lo -s 1500 -vX port 8083 or port 8088
        tcpdump: listening on lo, link-type EN10MB (Ethernet), capture size 1500 bytes
        09:48:21.876800 IP (tos 0x0, ttl 64, id 13344, offset 0, flags [DF], proto TCP (6), length 60)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [S], cksum 0x640b (correct), seq 2279143422, win 32792, options [mss 16396,sackOK,TS val 321504222 ecr 0,nop,wscale 9], length 0
        	0x0000:  4500 003c 3420 4000 4006 089a 7f00 0001  E..<4.@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f7fe 0000 0000  ................
        	0x0020:  a002 8018 640b 0000 0204 400c 0402 080a  ....d.....@.....
        	0x0030:  1329 c3de 0000 0000 0103 0309            .)..........
        09:48:21.876812 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (6), length 60)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [S.], cksum 0x4162 (correct), seq 2271462468, ack 2279143423, win 32768, options [mss 16396,sackOK,TS val 321504222 ecr 321504222,nop,wscale 9], length 0
        	0x0000:  4500 003c 0000 4000 4006 3cba 7f00 0001  E..<..@.@.<.....
        	0x0010:  7f00 0001 1f98 b508 8763 c444 87d8 f7ff  .........c.D....
        	0x0020:  a012 8000 4162 0000 0204 400c 0402 080a  ....Ab....@.....
        	0x0030:  1329 c3de 1329 c3de 0103 0309            .)...)......
        09:48:21.876821 IP (tos 0x0, ttl 64, id 13345, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x2a48 (correct), ack 1, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 3421 4000 4006 08a1 7f00 0001  E..44!@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f7ff 8763 c445  .............c.E
        	0x0020:  8010 0041 2a48 0000 0101 080a 1329 c3de  ...A*H.......)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.876903 IP (tos 0x0, ttl 64, id 13346, offset 0, flags [DF], proto TCP (6), length 85)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [P.], cksum 0xfe49 (incorrect -> 0xdcc6), seq 1:34, ack 1, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 33
        	0x0000:  4500 0055 3422 4000 4006 087f 7f00 0001  E..U4"@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f7ff 8763 c445  .............c.E
        	0x0020:  8018 0041 fe49 0000 0101 080a 1329 c3de  ...A.I.......)..
        	0x0030:  1329 c3de 7265 6164 2070 726f 7879 2e63  .)..read.proxy.c
        	0x0040:  6f6e 6669 672e 6d61 6e61 6765 725f 6269  onfig.manager_bi
        	0x0050:  6e61 7279 0a                             nary.
        09:48:21.876941 IP (tos 0x0, ttl 64, id 1947, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [.], cksum 0x2a28 (correct), ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 079b 4000 4006 3527 7f00 0001  E..4..@.@.5'....
        	0x0010:  7f00 0001 1f98 b508 8763 c445 87d8 f820  .........c.E....
        	0x0020:  8010 0040 2a28 0000 0101 080a 1329 c3de  ...@*(.......)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.876983 IP (tos 0x0, ttl 64, id 1948, offset 0, flags [DF], proto TCP (6), length 113)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [P.], cksum 0xfe65 (incorrect -> 0x0738), seq 1:62, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 61
        	0x0000:  4500 0071 079c 4000 4006 34e9 7f00 0001  E..q..@.@.4.....
        	0x0010:  7f00 0001 1f98 b508 8763 c445 87d8 f820  .........c.E....
        	0x0020:  8018 0040 fe65 0000 0101 080a 1329 c3de  ...@.e.......)..
        	0x0030:  1329 c3de 0a52 6563 6f72 6420 2770 726f  .)...Record.'pro
        	0x0040:  7879 2e63 6f6e 6669 672e 6d61 6e61 6765  xy.config.manage
        	0x0050:  725f 6269 6e61 7279 2720 5661 6c3a 2027  r_binary'.Val:.'
        	0x0060:  7472 6166 6669 635f 6d61 6e61 6765 7227  traffic_manager'
        	0x0070:  0a                                       .
        09:48:21.876990 IP (tos 0x0, ttl 64, id 13347, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x29ea (correct), ack 62, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 3423 4000 4006 089f 7f00 0001  E..44#@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f820 8763 c482  .............c..
        	0x0020:  8010 0041 29ea 0000 0101 080a 1329 c3de  ...A)........)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.876998 IP (tos 0x0, ttl 64, id 1949, offset 0, flags [DF], proto TCP (6), length 53)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [P.], cksum 0xfe29 (incorrect -> 0x1fe2), seq 62:63, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 1
        	0x0000:  4500 0035 079d 4000 4006 3524 7f00 0001  E..5..@.@.5$....
        	0x0010:  7f00 0001 1f98 b508 8763 c482 87d8 f820  .........c......
        	0x0020:  8018 0040 fe29 0000 0101 080a 1329 c3de  ...@.).......)..
        	0x0030:  1329 c3de 0a                             .)...
        09:48:21.877001 IP (tos 0x0, ttl 64, id 13348, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x29e9 (correct), ack 63, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 3424 4000 4006 089e 7f00 0001  E..44$@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f820 8763 c483  .............c..
        	0x0020:  8010 0041 29e9 0000 0101 080a 1329 c3de  ...A)........)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.877010 IP (tos 0x0, ttl 64, id 1950, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [F.], cksum 0x29e9 (correct), seq 63, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 079e 4000 4006 3524 7f00 0001  E..4..@.@.5$....
        	0x0010:  7f00 0001 1f98 b508 8763 c483 87d8 f820  .........c......
        	0x0020:  8011 0040 29e9 0000 0101 080a 1329 c3de  ...@)........)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.877040 IP (tos 0x0, ttl 64, id 13349, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [F.], cksum 0x29e7 (correct), seq 34, ack 64, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 3425 4000 4006 089d 7f00 0001  E..44%@.@.......
        	0x0010:  7f00 0001 b508 1f98 87d8 f820 8763 c484  .............c..
        	0x0020:  8011 0041 29e7 0000 0101 080a 1329 c3de  ...A)........)..
        	0x0030:  1329 c3de                                .)..
        09:48:21.877052 IP (tos 0x0, ttl 64, id 1951, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46344: Flags [.], cksum 0x29e8 (correct), ack 35, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0
        	0x0000:  4500 0034 079f 4000 4006 3523 7f00 0001  E..4..@.@.5#....
        	0x0010:  7f00 0001 1f98 b508 8763 c484 87d8 f821  .........c.....!
        	0x0020:  8010 0040 29e8 0000 0101 080a 1329 c3de  ...@)........)..
        	0x0030:  1329 c3de                                .)..
        09:48:31.877960 IP (tos 0x0, ttl 64, id 18342, offset 0, flags [DF], proto TCP (6), length 60)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [S], cksum 0xa739 (correct), seq 2438835529, win 32768, options [mss 16396,sackOK,TS val 321514223 ecr 321504222,nop,wscale 9], length 0
        	0x0000:  4500 003c 47a6 4000 4006 f513 7f00 0001  E..<G.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad49 0000 0000  .........].I....
        	0x0020:  a002 8000 a739 0000 0204 400c 0402 080a  .....9....@.....
        	0x0030:  1329 eaef 1329 c3de 0103 0309            .)...)......
        09:48:31.877973 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (6), length 60)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [S.], cksum 0x4736 (correct), seq 2432608226, ack 2438835530, win 32768, options [mss 16396,sackOK,TS val 321514223 ecr 321514223,nop,wscale 9], length 0
        	0x0000:  4500 003c 0000 4000 4006 3cba 7f00 0001  E..<..@.@.<.....
        	0x0010:  7f00 0001 1f98 b509 90fe a7e2 915d ad4a  .............].J
        	0x0020:  a012 8000 4736 0000 0204 400c 0402 080a  ....G6....@.....
        	0x0030:  1329 eaef 1329 eaef 0103 0309            .)...)......
        09:48:31.877990 IP (tos 0x0, ttl 64, id 18343, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x301d (correct), ack 1, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 47a7 4000 4006 f51a 7f00 0001  E..4G.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad4a 90fe a7e3  .........].J....
        	0x0020:  8010 0040 301d 0000 0101 080a 1329 eaef  ...@0........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878096 IP (tos 0x0, ttl 64, id 18344, offset 0, flags [DF], proto TCP (6), length 85)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [P.], cksum 0xfe49 (incorrect -> 0xe29b), seq 1:34, ack 1, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 33
        	0x0000:  4500 0055 47a8 4000 4006 f4f8 7f00 0001  E..UG.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad4a 90fe a7e3  .........].J....
        	0x0020:  8018 0040 fe49 0000 0101 080a 1329 eaef  ...@.I.......)..
        	0x0030:  1329 eaef 7265 6164 2070 726f 7879 2e63  .)..read.proxy.c
        	0x0040:  6f6e 6669 672e 6d61 6e61 6765 725f 6269  onfig.manager_bi
        	0x0050:  6e61 7279 0a                             nary.
        09:48:31.878108 IP (tos 0x0, ttl 64, id 19724, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [.], cksum 0x2ffc (correct), ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 4d0c 4000 4006 efb5 7f00 0001  E..4M.@.@.......
        	0x0010:  7f00 0001 1f98 b509 90fe a7e3 915d ad6b  .............].k
        	0x0020:  8010 0040 2ffc 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878199 IP (tos 0x0, ttl 64, id 19725, offset 0, flags [DF], proto TCP (6), length 113)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [P.], cksum 0xfe65 (incorrect -> 0x0d0c), seq 1:62, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 61
        	0x0000:  4500 0071 4d0d 4000 4006 ef77 7f00 0001  E..qM.@.@..w....
        	0x0010:  7f00 0001 1f98 b509 90fe a7e3 915d ad6b  .............].k
        	0x0020:  8018 0040 fe65 0000 0101 080a 1329 eaef  ...@.e.......)..
        	0x0030:  1329 eaef 0a52 6563 6f72 6420 2770 726f  .)...Record.'pro
        	0x0040:  7879 2e63 6f6e 6669 672e 6d61 6e61 6765  xy.config.manage
        	0x0050:  725f 6269 6e61 7279 2720 5661 6c3a 2027  r_binary'.Val:.'
        	0x0060:  7472 6166 6669 635f 6d61 6e61 6765 7227  traffic_manager'
        	0x0070:  0a                                       .
        09:48:31.878207 IP (tos 0x0, ttl 64, id 18345, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x2fbf (correct), ack 62, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 47a9 4000 4006 f518 7f00 0001  E..4G.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad6b 90fe a820  .........].k....
        	0x0020:  8010 0040 2fbf 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878216 IP (tos 0x0, ttl 64, id 19726, offset 0, flags [DF], proto TCP (6), length 53)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [P.], cksum 0xfe29 (incorrect -> 0x25b6), seq 62:63, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 1
        	0x0000:  4500 0035 4d0e 4000 4006 efb2 7f00 0001  E..5M.@.@.......
        	0x0010:  7f00 0001 1f98 b509 90fe a820 915d ad6b  .............].k
        	0x0020:  8018 0040 fe29 0000 0101 080a 1329 eaef  ...@.).......)..
        	0x0030:  1329 eaef 0a                             .)...
        09:48:31.878222 IP (tos 0x0, ttl 64, id 18346, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x2fbe (correct), ack 63, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 47aa 4000 4006 f517 7f00 0001  E..4G.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad6b 90fe a821  .........].k...!
        	0x0020:  8010 0040 2fbe 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878231 IP (tos 0x0, ttl 64, id 19727, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [F.], cksum 0x2fbd (correct), seq 63, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 4d0f 4000 4006 efb2 7f00 0001  E..4M.@.@.......
        	0x0010:  7f00 0001 1f98 b509 90fe a821 915d ad6b  ...........!.].k
        	0x0020:  8011 0040 2fbd 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878293 IP (tos 0x0, ttl 64, id 18347, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [F.], cksum 0x2fbc (correct), seq 34, ack 64, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 47ab 4000 4006 f516 7f00 0001  E..4G.@.@.......
        	0x0010:  7f00 0001 b509 1f98 915d ad6b 90fe a822  .........].k..."
        	0x0020:  8011 0040 2fbc 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        09:48:31.878306 IP (tos 0x0, ttl 64, id 19728, offset 0, flags [DF], proto TCP (6), length 52)
            127.0.0.1.radan-http > 127.0.0.1.46345: Flags [.], cksum 0x2fbc (correct), ack 35, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0
        	0x0000:  4500 0034 4d10 4000 4006 efb1 7f00 0001  E..4M.@.@.......
        	0x0010:  7f00 0001 1f98 b509 90fe a822 915d ad6c  ...........".].l
        	0x0020:  8010 0040 2fbc 0000 0101 080a 1329 eaef  ...@/........)..
        	0x0030:  1329 eaef                                .)..
        ^C
        24 packets captured
        48 packets received by filter
        0 packets dropped by kernel
        [root@test58 ~]# 
        
        Show
        Zhao Yongming added a comment - this issue is related to the cluster mode 1, and it is triggered in: static int heartbeat_manager() { int err; #ifdef TRACE_LOG_COP cop_log(COP_DEBUG, "Entering heartbeat_manager()\n" ); #endif // the CLI, and the rsport if cluster is enabled. err = test_mgmt_cli_port(); if ((0 == err) && (cluster_type != NO_CLUSTER)) err = test_rs_port(); here is the tcpdump on port 8088: [root@test58 ~]# tcpdump -n -i lo -s 1500 -vX port 8083 or port 8088 tcpdump: listening on lo, link-type EN10MB (Ethernet), capture size 1500 bytes 09:48:21.876800 IP (tos 0x0, ttl 64, id 13344, offset 0, flags [DF], proto TCP (6), length 60) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [S], cksum 0x640b (correct), seq 2279143422, win 32792, options [mss 16396,sackOK,TS val 321504222 ecr 0,nop,wscale 9], length 0 0x0000: 4500 003c 3420 4000 4006 089a 7f00 0001 E..<4.@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f7fe 0000 0000 ................ 0x0020: a002 8018 640b 0000 0204 400c 0402 080a ....d.....@..... 0x0030: 1329 c3de 0000 0000 0103 0309 .).......... 09:48:21.876812 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (6), length 60) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [S.], cksum 0x4162 (correct), seq 2271462468, ack 2279143423, win 32768, options [mss 16396,sackOK,TS val 321504222 ecr 321504222,nop,wscale 9], length 0 0x0000: 4500 003c 0000 4000 4006 3cba 7f00 0001 E..<..@.@.<..... 0x0010: 7f00 0001 1f98 b508 8763 c444 87d8 f7ff .........c.D.... 0x0020: a012 8000 4162 0000 0204 400c 0402 080a ....Ab....@..... 0x0030: 1329 c3de 1329 c3de 0103 0309 .)...)...... 09:48:21.876821 IP (tos 0x0, ttl 64, id 13345, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x2a48 (correct), ack 1, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 3421 4000 4006 08a1 7f00 0001 E..44!@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f7ff 8763 c445 .............c.E 0x0020: 8010 0041 2a48 0000 0101 080a 1329 c3de ...A*H.......).. 0x0030: 1329 c3de .).. 09:48:21.876903 IP (tos 0x0, ttl 64, id 13346, offset 0, flags [DF], proto TCP (6), length 85) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [P.], cksum 0xfe49 (incorrect -> 0xdcc6), seq 1:34, ack 1, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 33 0x0000: 4500 0055 3422 4000 4006 087f 7f00 0001 E..U4"@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f7ff 8763 c445 .............c.E 0x0020: 8018 0041 fe49 0000 0101 080a 1329 c3de ...A.I.......).. 0x0030: 1329 c3de 7265 6164 2070 726f 7879 2e63 .)..read.proxy.c 0x0040: 6f6e 6669 672e 6d61 6e61 6765 725f 6269 onfig.manager_bi 0x0050: 6e61 7279 0a nary. 09:48:21.876941 IP (tos 0x0, ttl 64, id 1947, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [.], cksum 0x2a28 (correct), ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 079b 4000 4006 3527 7f00 0001 E..4..@.@.5'.... 0x0010: 7f00 0001 1f98 b508 8763 c445 87d8 f820 .........c.E.... 0x0020: 8010 0040 2a28 0000 0101 080a 1329 c3de ...@*(.......).. 0x0030: 1329 c3de .).. 09:48:21.876983 IP (tos 0x0, ttl 64, id 1948, offset 0, flags [DF], proto TCP (6), length 113) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [P.], cksum 0xfe65 (incorrect -> 0x0738), seq 1:62, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 61 0x0000: 4500 0071 079c 4000 4006 34e9 7f00 0001 E..q..@.@.4..... 0x0010: 7f00 0001 1f98 b508 8763 c445 87d8 f820 .........c.E.... 0x0020: 8018 0040 fe65 0000 0101 080a 1329 c3de ...@.e.......).. 0x0030: 1329 c3de 0a52 6563 6f72 6420 2770 726f .)...Record.'pro 0x0040: 7879 2e63 6f6e 6669 672e 6d61 6e61 6765 xy.config.manage 0x0050: 725f 6269 6e61 7279 2720 5661 6c3a 2027 r_binary'.Val:.' 0x0060: 7472 6166 6669 635f 6d61 6e61 6765 7227 traffic_manager' 0x0070: 0a . 09:48:21.876990 IP (tos 0x0, ttl 64, id 13347, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x29ea (correct), ack 62, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 3423 4000 4006 089f 7f00 0001 E..44#@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f820 8763 c482 .............c.. 0x0020: 8010 0041 29ea 0000 0101 080a 1329 c3de ...A)........).. 0x0030: 1329 c3de .).. 09:48:21.876998 IP (tos 0x0, ttl 64, id 1949, offset 0, flags [DF], proto TCP (6), length 53) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [P.], cksum 0xfe29 (incorrect -> 0x1fe2), seq 62:63, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 1 0x0000: 4500 0035 079d 4000 4006 3524 7f00 0001 E..5..@.@.5$.... 0x0010: 7f00 0001 1f98 b508 8763 c482 87d8 f820 .........c...... 0x0020: 8018 0040 fe29 0000 0101 080a 1329 c3de ...@.).......).. 0x0030: 1329 c3de 0a .)... 09:48:21.877001 IP (tos 0x0, ttl 64, id 13348, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [.], cksum 0x29e9 (correct), ack 63, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 3424 4000 4006 089e 7f00 0001 E..44$@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f820 8763 c483 .............c.. 0x0020: 8010 0041 29e9 0000 0101 080a 1329 c3de ...A)........).. 0x0030: 1329 c3de .).. 09:48:21.877010 IP (tos 0x0, ttl 64, id 1950, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [F.], cksum 0x29e9 (correct), seq 63, ack 34, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 079e 4000 4006 3524 7f00 0001 E..4..@.@.5$.... 0x0010: 7f00 0001 1f98 b508 8763 c483 87d8 f820 .........c...... 0x0020: 8011 0040 29e9 0000 0101 080a 1329 c3de ...@)........).. 0x0030: 1329 c3de .).. 09:48:21.877040 IP (tos 0x0, ttl 64, id 13349, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46344 > 127.0.0.1.radan-http: Flags [F.], cksum 0x29e7 (correct), seq 34, ack 64, win 65, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 3425 4000 4006 089d 7f00 0001 E..44%@.@....... 0x0010: 7f00 0001 b508 1f98 87d8 f820 8763 c484 .............c.. 0x0020: 8011 0041 29e7 0000 0101 080a 1329 c3de ...A)........).. 0x0030: 1329 c3de .).. 09:48:21.877052 IP (tos 0x0, ttl 64, id 1951, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46344: Flags [.], cksum 0x29e8 (correct), ack 35, win 64, options [nop,nop,TS val 321504222 ecr 321504222], length 0 0x0000: 4500 0034 079f 4000 4006 3523 7f00 0001 E..4..@.@.5#.... 0x0010: 7f00 0001 1f98 b508 8763 c484 87d8 f821 .........c.....! 0x0020: 8010 0040 29e8 0000 0101 080a 1329 c3de ...@)........).. 0x0030: 1329 c3de .).. 09:48:31.877960 IP (tos 0x0, ttl 64, id 18342, offset 0, flags [DF], proto TCP (6), length 60) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [S], cksum 0xa739 (correct), seq 2438835529, win 32768, options [mss 16396,sackOK,TS val 321514223 ecr 321504222,nop,wscale 9], length 0 0x0000: 4500 003c 47a6 4000 4006 f513 7f00 0001 E..<G.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad49 0000 0000 .........].I.... 0x0020: a002 8000 a739 0000 0204 400c 0402 080a .....9....@..... 0x0030: 1329 eaef 1329 c3de 0103 0309 .)...)...... 09:48:31.877973 IP (tos 0x0, ttl 64, id 0, offset 0, flags [DF], proto TCP (6), length 60) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [S.], cksum 0x4736 (correct), seq 2432608226, ack 2438835530, win 32768, options [mss 16396,sackOK,TS val 321514223 ecr 321514223,nop,wscale 9], length 0 0x0000: 4500 003c 0000 4000 4006 3cba 7f00 0001 E..<..@.@.<..... 0x0010: 7f00 0001 1f98 b509 90fe a7e2 915d ad4a .............].J 0x0020: a012 8000 4736 0000 0204 400c 0402 080a ....G6....@..... 0x0030: 1329 eaef 1329 eaef 0103 0309 .)...)...... 09:48:31.877990 IP (tos 0x0, ttl 64, id 18343, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x301d (correct), ack 1, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 47a7 4000 4006 f51a 7f00 0001 E..4G.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad4a 90fe a7e3 .........].J.... 0x0020: 8010 0040 301d 0000 0101 080a 1329 eaef ...@0........).. 0x0030: 1329 eaef .).. 09:48:31.878096 IP (tos 0x0, ttl 64, id 18344, offset 0, flags [DF], proto TCP (6), length 85) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [P.], cksum 0xfe49 (incorrect -> 0xe29b), seq 1:34, ack 1, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 33 0x0000: 4500 0055 47a8 4000 4006 f4f8 7f00 0001 E..UG.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad4a 90fe a7e3 .........].J.... 0x0020: 8018 0040 fe49 0000 0101 080a 1329 eaef ...@.I.......).. 0x0030: 1329 eaef 7265 6164 2070 726f 7879 2e63 .)..read.proxy.c 0x0040: 6f6e 6669 672e 6d61 6e61 6765 725f 6269 onfig.manager_bi 0x0050: 6e61 7279 0a nary. 09:48:31.878108 IP (tos 0x0, ttl 64, id 19724, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [.], cksum 0x2ffc (correct), ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 4d0c 4000 4006 efb5 7f00 0001 E..4M.@.@....... 0x0010: 7f00 0001 1f98 b509 90fe a7e3 915d ad6b .............].k 0x0020: 8010 0040 2ffc 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. 09:48:31.878199 IP (tos 0x0, ttl 64, id 19725, offset 0, flags [DF], proto TCP (6), length 113) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [P.], cksum 0xfe65 (incorrect -> 0x0d0c), seq 1:62, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 61 0x0000: 4500 0071 4d0d 4000 4006 ef77 7f00 0001 E..qM.@.@..w.... 0x0010: 7f00 0001 1f98 b509 90fe a7e3 915d ad6b .............].k 0x0020: 8018 0040 fe65 0000 0101 080a 1329 eaef ...@.e.......).. 0x0030: 1329 eaef 0a52 6563 6f72 6420 2770 726f .)...Record.'pro 0x0040: 7879 2e63 6f6e 6669 672e 6d61 6e61 6765 xy.config.manage 0x0050: 725f 6269 6e61 7279 2720 5661 6c3a 2027 r_binary'.Val:.' 0x0060: 7472 6166 6669 635f 6d61 6e61 6765 7227 traffic_manager' 0x0070: 0a . 09:48:31.878207 IP (tos 0x0, ttl 64, id 18345, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x2fbf (correct), ack 62, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 47a9 4000 4006 f518 7f00 0001 E..4G.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad6b 90fe a820 .........].k.... 0x0020: 8010 0040 2fbf 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. 09:48:31.878216 IP (tos 0x0, ttl 64, id 19726, offset 0, flags [DF], proto TCP (6), length 53) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [P.], cksum 0xfe29 (incorrect -> 0x25b6), seq 62:63, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 1 0x0000: 4500 0035 4d0e 4000 4006 efb2 7f00 0001 E..5M.@.@....... 0x0010: 7f00 0001 1f98 b509 90fe a820 915d ad6b .............].k 0x0020: 8018 0040 fe29 0000 0101 080a 1329 eaef ...@.).......).. 0x0030: 1329 eaef 0a .)... 09:48:31.878222 IP (tos 0x0, ttl 64, id 18346, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [.], cksum 0x2fbe (correct), ack 63, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 47aa 4000 4006 f517 7f00 0001 E..4G.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad6b 90fe a821 .........].k...! 0x0020: 8010 0040 2fbe 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. 09:48:31.878231 IP (tos 0x0, ttl 64, id 19727, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [F.], cksum 0x2fbd (correct), seq 63, ack 34, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 4d0f 4000 4006 efb2 7f00 0001 E..4M.@.@....... 0x0010: 7f00 0001 1f98 b509 90fe a821 915d ad6b ...........!.].k 0x0020: 8011 0040 2fbd 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. 09:48:31.878293 IP (tos 0x0, ttl 64, id 18347, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.46345 > 127.0.0.1.radan-http: Flags [F.], cksum 0x2fbc (correct), seq 34, ack 64, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 47ab 4000 4006 f516 7f00 0001 E..4G.@.@....... 0x0010: 7f00 0001 b509 1f98 915d ad6b 90fe a822 .........].k..." 0x0020: 8011 0040 2fbc 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. 09:48:31.878306 IP (tos 0x0, ttl 64, id 19728, offset 0, flags [DF], proto TCP (6), length 52) 127.0.0.1.radan-http > 127.0.0.1.46345: Flags [.], cksum 0x2fbc (correct), ack 35, win 64, options [nop,nop,TS val 321514223 ecr 321514223], length 0 0x0000: 4500 0034 4d10 4000 4006 efb1 7f00 0001 E..4M.@.@....... 0x0010: 7f00 0001 1f98 b509 90fe a822 915d ad6c ...........".].l 0x0020: 8010 0040 2fbc 0000 0101 080a 1329 eaef ...@/........).. 0x0030: 1329 eaef .).. ^C 24 packets captured 48 packets received by filter 0 packets dropped by kernel [root@test58 ~]#
        Hide
        Zhao Yongming added a comment -

        there may hide two problem:
        1, why cop->manager heartbeat failed with "[WARNING]: (manager test) bad response value"
        2, why the safe_kill killed cop itself by the end

        Show
        Zhao Yongming added a comment - there may hide two problem: 1, why cop->manager heartbeat failed with " [WARNING] : (manager test) bad response value" 2, why the safe_kill killed cop itself by the end

          People

          • Assignee:
            Zhao Yongming
            Reporter:
            Zhao Yongming
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development