Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-706

large numbers of watches can cause session re-establishment to fail

    XMLWordPrintableJSON

Details

    Description

      If a client sets a large number of watches the "set watches" operation during session re-establishment can fail.

      for example:
      WARN [NIOServerCxn.Factory:22801:NIOServerCnxn@417] - Exception causing close of session 0xe727001201a4ee7c due to java.io.IOException: Len error 4348380

      in this case the client was a web monitoring app and had set both data and child watches on > 32k znodes.

      there are two issues I see here we need to fix:

      1) handle this case properly (split up the set watches into multiple calls I guess...)
      2) the session should have expired after the "timeout". however we seem to consider any message from the client as re-setting the expiration on the server side. Probably we should only consider messages from the client that are sent during an established session, otherwise we can see this situation where the session is not established however the session is not expired either. Perhaps we should create another JIRA for this particular issue.

      Attachments

        1. ZOOKEEPER-706.patch
          8 kB
          Chris Thunes
        2. ZOOKEEPER-706.patch
          8 kB
          Chris Thunes
        3. ZOOKEEPER-706.patch
          5 kB
          Chris Thunes
        4. ZOOKEEPER-706-branch-34.patch
          9 kB
          Chris Thunes
        5. ZOOKEEPER-706-branch-34.patch
          9 kB
          Chris Thunes

        Issue Links

          Activity

            People

              cthunes Chris Thunes
              phunt Patrick D. Hunt
              Votes:
              7 Vote for this issue
              Watchers:
              33 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m