Uploaded image for project: 'Mesos'
  1. Mesos
  2. MESOS-522

ZooKeeperMasterDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • None
    • None

    Description

      Yan is working on cleaning up the master detection code, so assigning to him to make sure the tests are not flaky as he wraps his changes up.

      [ RUN ] ZooKeeperMasterDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster
      I0624 02:55:07.281365 32750 zookeeper_test_server.cpp:113] Started ZooKeeperTestServer on port 32783
      I0624 02:55:07.428186 364 detector.cpp:234] Master detector ((741)@67.195.138.8:38688) connected to ZooKeeper ...
      I0624 02:55:07.428232 364 detector.cpp:251] Trying to create path '/mesos' in ZooKeeper
      I0624 02:55:07.632359 364 detector.cpp:281] Created ephemeral/sequence znode at '/mesos/0000000000'
      I0624 02:55:07.633204 364 detector.cpp:420] Master detector ((741)@67.195.138.8:38688) found 1 registered masters
      I0624 02:55:07.735405 364 detector.cpp:467] Master detector ((741)@67.195.138.8:38688) got new master pid: (741)@67.195.138.8:38688
      I0624 02:55:07.941438 362 detector.cpp:234] Master detector ((744)@67.195.138.8:38688) connected to ZooKeeper ...
      I0624 02:55:08.151450 362 detector.cpp:251] Trying to create path '/mesos' in ZooKeeper
      I0624 02:55:08.457007 362 detector.cpp:281] Created ephemeral/sequence znode at '/mesos/0000000001'
      I0624 02:55:08.457700 365 detector.cpp:420] Master detector ((741)@67.195.138.8:38688) found 2 registered masters
      I0624 02:55:08.609033 362 detector.cpp:420] Master detector ((744)@67.195.138.8:38688) found 2 registered masters
      I0624 02:55:08.750154 362 detector.cpp:467] Master detector ((744)@67.195.138.8:38688) got new master pid: (741)@67.195.138.8:38688
      I0624 02:55:08.986557 366 detector.cpp:234] Master detector ((747)@67.195.138.8:38688) connected to ZooKeeper ...
      I0624 02:55:09.211014 366 detector.cpp:251] Trying to create path '/mesos' in ZooKeeper
      I0624 02:55:09.284556 366 detector.cpp:420] Master detector ((747)@67.195.138.8:38688) found 2 registered masters
      I0624 02:55:09.507561 366 detector.cpp:467] Master detector ((747)@67.195.138.8:38688) got new master pid: (741)@67.195.138.8:38688
      2013-06-24 02:55:09,528:32750(0x2af8a5578700):ZOO_ERROR@handle_socket_error_msg@1603: Socket [127.0.0.1:32783] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
      2013-06-24 02:55:09,529:32750(0x2af8a5176700):ZOO_ERROR@handle_socket_error_msg@1603: Socket [127.0.0.1:32783] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
      I0624 02:55:09.528509 359 detector.cpp:325] Master detector ((747)@67.195.138.8:38688) lost connection to ZooKeeper, attempting to reconnect ...
      E0624 02:55:09.529320 360 detector.cpp:412] Master detector ((741)@67.195.138.8:38688) failed to get masters: connection loss
      I0624 02:55:09.529669 365 detector.cpp:420] Master detector ((744)@67.195.138.8:38688) found 1 registered masters
      I0624 02:55:10.027983 360 detector.cpp:325] Master detector ((741)@67.195.138.8:38688) lost connection to ZooKeeper, attempting to reconnect ...
      I0624 02:55:10.139279 365 detector.cpp:467] Master detector ((744)@67.195.138.8:38688) got new master pid: (744)@67.195.138.8:38688
      2013-06-24 02:55:12,866:32750(0x2af8a5578700):ZOO_ERROR@handle_socket_error_msg@1621: Socket [127.0.0.1:32783] zk retcode=-112, errno=116(Stale NFS file handle): sessionId=0x13f741b34100002 has expired.
      W0624 02:55:12.866436 366 detector.cpp:344] Master detector ((747)@67.195.138.8:38688) ZooKeeper session expired!
      2013-06-24 02:55:12,867:32750(0x2af8a5176700):ZOO_ERROR@handle_socket_error_msg@1621: Socket [127.0.0.1:32783] zk retcode=-112, errno=116(Stale NFS file handle): sessionId=0x13f741b34100000 has expired.
      W0624 02:55:12.867856 359 detector.cpp:344] Master detector ((741)@67.195.138.8:38688) ZooKeeper session expired!
      I0624 02:55:13.097888 361 detector.cpp:234] Master detector ((747)@67.195.138.8:38688) connected to ZooKeeper ...
      I0624 02:55:13.522637 366 detector.cpp:234] Master detector ((741)@67.195.138.8:38688) connected to ZooKeeper ...
      I0624 02:55:13.695116 366 detector.cpp:251] Trying to create path '/mesos' in ZooKeeper
      I0624 02:55:13.593791 361 detector.cpp:251] Trying to create path '/mesos' in ZooKeeper
      I0624 02:55:13.810425 366 detector.cpp:281] Created ephemeral/sequence znode at '/mesos/0000000003'
      I0624 02:55:13.810853 359 detector.cpp:420] Master detector ((744)@67.195.138.8:38688) found 2 registered masters
      I0624 02:55:13.916301 361 detector.cpp:420] Master detector ((747)@67.195.138.8:38688) found 2 registered masters
      I0624 02:55:14.124788 366 detector.cpp:420] Master detector ((741)@67.195.138.8:38688) found 2 registered masters
      ../../src/tests/master_detector_tests.cpp:615: Failure
      Failed to wait 5secs for newMasterDetected4
      I0624 02:55:14.330525 361 detector.cpp:467] Master detector ((747)@67.195.138.8:38688) got new master pid: (744)@67.195.138.8:38688
      I0624 02:55:14.434010 366 detector.cpp:467] Master detector ((741)@67.195.138.8:38688) got new master pid: (744)@67.195.138.8:38688
      I0624 02:55:14.648669 32750 zookeeper_test_server.cpp:93] Shutdown ZooKeeperTestServer on port 32783
      [ FAILED ] ZooKeeperMasterDetectorTest.MasterDetectorExpireSlaveZKSessionNewMaster (7377 ms)

      Attachments

        Activity

          People

            vinodkone Vinod Kone
            bmahler Benjamin Mahler
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: