[NIFI-2415] GenerateTableFetch/QueryDatabaseTable cannot store state

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Not A Bug
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.0, 1.0.0-Beta
• Component/s: Extensions
• Assignee: Matt Burgess
• Reporter: Haimo Liu
• Created: 28/Jul/16 03:21
• Updated: 08/Aug/18 14:36
• Resolved: 28/Jul/16 13:33

Description

running NIFI in a clustered mode, 7/27 build

Both GenerateTableFetch and QueryDatabaseTable cannot store state in a clustered mode (checked ListFile, can store state successfully)

see attached screenshot, trace below:

2016-07-27 23:25:00,014 INFO [ProcessThread(sid:1 cport:-1):] o.a.z.server.PrepRequestProcessor Got user-level KeeperException when processing sessionid:0x2562f7875130009 type:create cxid:0xe4d zxid:0x700003733 txntype:-1 reqpath:n/a Error Path:/nifi/components/2f810bb3-0156-1000-0000-000016128f8b Error:KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b
2016-07-27 23:25:00,017 WARN [Framework Task Thread Thread-1] o.a.n.c.s.m.StandardStateManagerProvider Component with ID {} was removed from NiFi instance but failed to clear clustered state for the component
java.io.IOException: Failed to set cluster-wide state in ZooKeeper for component with ID 2f810bb3-0156-1000-0000-000016128f8b
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:343) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:283) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:228) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.clear(ZooKeeperStateProvider.java:453) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.StandardStateManager.clear(StandardStateManager.java:85) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.manager.StandardStateManagerProvider.onComponentRemoved(StandardStateManagerProvider.java:276) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.groups.StandardProcessGroup$1.run(StandardProcessGroup.java:730) [nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_77]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_77]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_77]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_77]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_77]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_77]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_77]
Caused by: org.apache.zookeeper.KeeperException$InvalidACLException: KeeperErrorCode = InvalidACL for /nifi/components/2f810bb3-0156-1000-0000-000016128f8b
at org.apache.zookeeper.KeeperException.create(KeeperException.java:121) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ~[nifi-framework-core-1.0.0-SNAPSHOT.jar:1.0.0-SNAPSHOT]
... 13 common frames omitted