[STORM-1601] Cluster-state must check if znode exists before getting children for storm backpressure

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0, 2.0.0
• Fix Version/s: 1.0.0
• Component/s: storm-core
• Assignee: Kishor Patil
• Reporter: Kishor Patil
• Created: 03/Mar/16 18:31
• Updated: 04/Mar/16 15:48
• Resolved: 04/Mar/16 15:48

Description

You see below exception in the integration tests..

15:46:23 java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /backpressure/topologytest-22ffcfa0-8992-4258-b8b6-52346a129b58-1-0
15:46:23 at backtype.storm.util$wrap_in_runtime.invoke(util.clj:52) ~[classes/:?]
15:46:23 at backtype.storm.zookeeper$get_children.invoke(zookeeper.clj:168) ~[classes/:?]
15:46:23 at backtype.storm.cluster_state.zookeeper_state_factory$mkState$reify_4184.get_children(zookeeper_state_factory.clj:129) ~[classes/:?]
15:46:23 at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) ~[?:?]
15:46:23 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_60]
15:46:23 at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_60]
15:46:23 at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.6.0.jar:?]
15:46:23 at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.6.0.jar:?]
15:46:23 at backtype.storm.cluster$mk_storm_cluster_state$reify__4091.topology_backpressure(cluster.clj:407) ~[classes/:?]
15:46:23 at sun.reflect.GeneratedMethodAccessor210.invoke(Unknown Source) ~[?:?]
15:46:23 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_60]
15:46:23 at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_60]
15:46:23 at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.6.0.jar:?]
15:46:23 at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.6.0.jar:?]
15:46:23 at backtype.storm.daemon.worker$fn_6837$exec_fn1477auto$reify6839$check_throttle_changed6910$cb_6911.doInvoke(worker.clj:704) ~[classes/:?]
15:46:23 at clojure.lang.RestFn.invoke(RestFn.java:408) ~[clojure-1.6.0.jar:?]
15:46:23 at backtype.storm.cluster$issue_map_callback_BANG_.invoke(cluster.clj:183) ~[classes/:?]
15:46:23 at backtype.storm.cluster$mk_storm_cluster_state$fn__4081.invoke(cluster.clj:239) ~[classes/:?]
15:46:23 at backtype.storm.cluster_state.zookeeper_state_factory$mkState$fn_4166.invoke(zookeeper_state_factory.clj:45) ~[classes/:?]
15:46:23 at backtype.storm.zookeeper$mk_client$reify__2993.eventReceived(zookeeper.clj:63) ~[classes/:?]
15:46:23 at org.apache.curator.framework.imps.CuratorFrameworkImpl$8.apply(CuratorFrameworkImpl.java:860) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.CuratorFrameworkImpl$8.apply(CuratorFrameworkImpl.java:853) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92) [curator-framework-2.5.0.jar:?]
15:46:23 at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
15:46:23 at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.CuratorFrameworkImpl.processEvent(CuratorFrameworkImpl.java:850) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.CuratorFrameworkImpl.access$000(CuratorFrameworkImpl.java:57) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.CuratorFrameworkImpl$1.process(CuratorFrameworkImpl.java:138) [curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.ConnectionState.process(ConnectionState.java:152) [curator-client-2.5.0.jar:?]
15:46:23 at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522) [zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498) [zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /backpressure/topologytest-22ffcfa0-8992-4258-b8b6-52346a129b58-1-0
15:46:23 at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1590) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1625) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
15:46:23 at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:210) ~[curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203) ~[curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[curator-client-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:199) ~[curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191) ~[curator-framework-2.5.0.jar:?]
15:46:23 at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38) ~[curator-framework-2.5.0.jar:?]
15:46:23 at sun.reflect.GeneratedMethodAccessor93.invoke(Unknown Source) ~[?:?]
15:46:23 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_60]
15:46:23 at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_60]
15:46:23 at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.6.0.jar:?]
15:46:23 at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.6.0.jar:?]
15:46:23 at backtype.storm.zookeeper$get_children.invoke(zookeeper.clj:166) ~[classes/:?]
15:46:23 ... 29 more