[STORM-531] NoOutputException error when a topology is submitted: "java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read. Serializer Exception:"

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.3
• Fix Version/s: 0.9.3
• Component/s: storm-core
• Environment: Open suse
• Assignee: Harsha
• Reporter: Enayat
• Created: 14/Oct/14 10:05
• Updated: 05/Oct/15 01:40
• Resolved: 09/Mar/15 00:12

Description

When I want to submit the WordCountTopology, after running the storm jar ...., the following error comes and it does not the topology in the ui!

23543 [Thread-31] ERROR backtype.storm.task.ShellBolt - Halting process: ShellBolt died.
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
(Unable to capture error stream)

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23552 [Thread-31] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
(Unable to capture error stream)

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23554 [main] INFO backtype.storm.daemon.executor - Shut down executor split:[6 6]
23554 [main] INFO backtype.storm.daemon.executor - Shutting down executor split:[7 7]
23555 [Thread-18-split] INFO backtype.storm.util - Async loop interrupted!
23555 [Thread-22-spout] INFO backtype.storm.daemon.task - Emitting: spout default [an apple a day keeps the doctor away]
23557 [Thread-17-disruptor-executor[7 7]-send-queue] INFO backtype.storm.util - Async loop interrupted!
23559 [main] INFO backtype.storm.daemon.executor - Shut down executor split:[7 7]
23559 [main] INFO backtype.storm.daemon.executor - Shutting down executor spout:[8 8]
23560 [Thread-19-disruptor-executor[8 8]-send-queue] INFO backtype.storm.util - Async loop interrupted!
23560 [Thread-20-spout] INFO backtype.storm.util - Async loop interrupted!
23560 [main] INFO backtype.storm.daemon.executor - Shut down executor spout:[8 8]
23560 [main] INFO backtype.storm.daemon.executor - Shutting down executor spout:[9 9]
23561 [Thread-33] ERROR backtype.storm.task.ShellBolt - Halting process: ShellBolt died.
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23561 [Thread-33] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23562 [Thread-32] ERROR backtype.storm.task.ShellBolt - Halting process: ShellBolt died.
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23562 [Thread-32] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be broken! No output read.
Serializer Exception:

at backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
23562 [Thread-21-disruptor-executor[9 9]-send-queue] INFO backtype.storm.util - Async loop interrupted!
23564 [Thread-32] ERROR org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread Thread[Thread-32,5,main] died
java.lang.RuntimeException: java.lang.InterruptedException
at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:102) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_.invoke(zookeeper.clj:98) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:114) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$fn_4321$fn$reify_4366.reportError(executor.clj:737) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.die(ShellBolt.java:303) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
Caused by: java.lang.InterruptedException: null
at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
at org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:172) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:161) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:157) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:148) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:36) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
... 12 common frames omitted
23565 [Thread-33] ERROR org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread Thread[Thread-33,5,main] died
java.lang.RuntimeException: java.lang.InterruptedException
at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:102) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_.invoke(zookeeper.clj:98) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:114) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$fn_4321$fn$reify_4366.reportError(executor.clj:737) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.die(ShellBolt.java:303) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
Caused by: java.lang.InterruptedException: null
at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
at org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:172) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:161) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:157) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:148) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:36) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:101) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
... 12 common frames omitted
23568 [Thread-22-spout] INFO backtype.storm.util - Async loop interrupted!
23570 [main] INFO backtype.storm.daemon.executor - Shut down executor spout:[9 9]
23570 [main] INFO backtype.storm.daemon.executor - Shutting down executor spout:[10 10]
23571 [Thread-23-disruptor-executor[10 10]-send-queue] INFO backtype.storm.util - Async loop interrupted!
23573 [Thread-31] ERROR org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread Thread[Thread-31,5,main] died
java.lang.RuntimeException: java.lang.InterruptedException
at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$create_node.invoke(zookeeper.clj:91) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:117) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.daemon.executor$fn_4321$fn$reify_4366.reportError(executor.clj:737) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.die(ShellBolt.java:303) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
Caused by: java.lang.InterruptedException: null
at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
at org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.zookeeper.ZooKeeper.create(ZooKeeper.java:781) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:676) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:660) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl.pathInForeground(CreateBuilderImpl.java:656) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl.protectedPathInForeground(CreateBuilderImpl.java:441) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:431) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl$3.forPath(CreateBuilderImpl.java:239) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at org.apache.storm.curator.framework.imps.CreateBuilderImpl$3.forPath(CreateBuilderImpl.java:193) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.6.0_24]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.6.0_24]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.6.0_24]
at java.lang.reflect.Method.invoke(Method.java:616) ~[na:1.6.0_24]
at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.5.1.jar:na]
at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.5.1.jar:na]
at backtype.storm.zookeeper$create_node.invoke(zookeeper.clj:90) ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
... 11 common frames omitted