Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2415

GenerateTableFetch/QueryDatabaseTable cannot store state

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Not A Bug
    • 1.0.0
    • 1.0.0, 1.0.0-Beta
    • Extensions
    • None

    Description

      running NIFI in a clustered mode, 7/27 build

      Both GenerateTableFetch and QueryDatabaseTable cannot store state in a clustered mode (checked ListFile, can store state successfully)

      see attached screenshot, trace below:

      2016-07-27 23:25:00,014 INFO [ProcessThread(sid:1 cport:-1):] o.a.z.server.PrepRequestProcessor Got user-level KeeperException when processing sessionid:0x2562f7875130009 type:create cxid:0xe4d zxid:0x700003733 txntype:-1 reqpath:n/a Error Path:/nifi/components/2f810bb3-0156-1000-0000-000016128f8b Error:KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b
      2016-07-27 23:25:00,017 WARN [Framework Task Thread Thread-1] o.a.n.c.s.m.StandardStateManagerProvider Component with ID {} was removed from NiFi instance but failed to clear clustered state for the component
      java.io.IOException: Failed to set cluster-wide state in ZooKeeper for component with ID 2f810bb3-0156-1000-0000-000016128f8b
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:343) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:283) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:228) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.clear(ZooKeeperStateProvider.java:453) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.StandardStateManager.clear(StandardStateManager.java:85) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.onComponentRemoved(StandardStateManagerProvider.java:276) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.groups.StandardProcessGroup$1.run(StandardProcessGroup.java:730) [nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_77]
      at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_77]
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_77]
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_77]
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77]
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77]
      at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77]
      Caused by: org.apache.zookeeper.KeeperException$InvalidACLException: KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b
      at org.apache.zookeeper.KeeperException.create(KeeperException.java:121) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
      at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
      at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
      ... 13 common frames omitted

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mattyb149 Matt Burgess
            h_liu Haimo Liu
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment