Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-8426

Endless retrying zk set data for a large query

VotersStop watchingWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.21.1
    • 1.21.2
    • Execution - Flow
    • None

    Description

      If to issue a large query (bigger than 1MB) Drill can fall down into infinite loop of retries to set data to zookeeper.

      In zookeeper logs you will see repeating errors like this:

      java.io.IOException: Len error 112569

      In drillbit logs you may see errors like this:

      Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /drill/magic-drillbits/ea569524-abaa-41e2-9f69-7857f3a04b6c
              at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
              at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
              at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:2419)
              at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:291)
              at org.apache.curator.framework.imps.SetDataBuilderImpl$4.call(SetDataBuilderImpl.java:287)
              at org.apache.curator.connection.StandardConnectionHandlingPolicy.callWithRetry(StandardConnectionHandlingPolicy.java:67)
              at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:81)
              at org.apache.curator.framework.imps.SetDataBuilderImpl.pathInForeground(SetDataBuilderImpl.java:284)
              at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:270)
              at org.apache.curator.framework.imps.SetDataBuilderImpl.forPath(SetDataBuilderImpl.java:33)
              at org.apache.curator.x.discovery.details.ServiceDiscoveryImpl.updateService(ServiceDiscoveryImpl.java:208)

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mrymar Maksym Rymar
            mrymar Maksym Rymar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment