[STORM-2774] Workers get killed with FileNotFoundException on stormjar.jar

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.1.0
• Component/s: storm-core
• Assignee: Unassigned
• Reporter: Sreeram Venkatasubramanian
• Created: 12/Oct/17 14:20
• Updated: 12/Oct/17 14:20

Description

Hi,

Worker processes sometimes get killed unable to find stormjar.jar in tmp directory. The stacktrace looks as below.

10.0.0.113 2017-10-12 10:28:33.657 STDERR Thread-1 [INFO] Caused by: java.lang.RuntimeException: Provider for class javax.xml.parsers.DocumentBuilderFactory cannot be c
reated
10.0.0.113 2017-10-12 10:28:33.657 STDERR Thread-1 [INFO] at javax.xml.parsers.FactoryFinder.findServiceProvider(FactoryFinder.java:308)
10.0.0.113 2017-10-12 10:28:33.657 STDERR Thread-1 [INFO] ... 85 more
10.0.0.113 2017-10-12 10:28:33.657 STDERR Thread-1 [INFO] Caused by: java.util.ServiceConfigurationError: javax.xml.parsers.DocumentBuilderFactory: Error reading config
uration file
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader.fail(ServiceLoader.java:232)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader.parse(ServiceLoader.java:309)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader.access$200(ServiceLoader.java:185)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader$LazyIterator.hasNextService(ServiceLoader.java:357)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader$LazyIterator.hasNext(ServiceLoader.java:393)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.util.ServiceLoader$1.hasNext(ServiceLoader.java:474)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at javax.xml.parsers.FactoryFinder$1.run(FactoryFinder.java:293)
10.0.0.113 2017-10-12 10:28:33.658 STDERR Thread-1 [INFO] at java.security.AccessController.doPrivileged(Native Method)
10.0.0.113 2017-10-12 10:28:33.659 STDERR Thread-1 [INFO] at javax.xml.parsers.FactoryFinder.findServiceProvider(FactoryFinder.java:289)
10.0.0.113 2017-10-12 10:28:33.659 STDERR Thread-1 [INFO] ... 85 more
10.0.0.113 2017-10-12 10:28:33.659 STDERR Thread-1 [INFO] Caused by: java.io.FileNotFoundException: /var/log/storm/tmp/supervisor/stormdist/R2Topology-80-1507783551/stormjar.jar (No such file or directory)
10.0.0.113 2017-10-12 10:28:33.659 STDERR Thread-1 [INFO] at java.util.zip.ZipFile.open(Native Method)
10.0.0.113 2017-10-12 10:28:33.659 STDERR Thread-1 [INFO] at java.util.zip.ZipFile.<init>(ZipFile.java:219)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at java.util.zip.ZipFile.<init>(ZipFile.java:149)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at java.util.jar.JarFile.<init>(JarFile.java:166)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at java.util.jar.JarFile.<init>(JarFile.java:103)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at sun.net.www.protocol.jar.URLJarFile.<init>(URLJarFile.java:93)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at sun.net.www.protocol.jar.URLJarFile.getJarFile(URLJarFile.java:69)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at sun.net.www.protocol.jar.JarFileFactory.get(JarFileFactory.java:84)
10.0.0.113 2017-10-12 10:28:33.660 STDERR Thread-1 [INFO] at sun.net.www.protocol.jar.JarURLConnection.connect(JarURLConnection.java:122)
10.0.0.113 2017-10-12 10:28:33.661 STDERR Thread-1 [INFO] at sun.net.www.protocol.jar.JarURLConnection.getInputStream(JarURLConnection.java:150)
10.0.0.113 2017-10-12 10:28:33.661 STDERR Thread-1 [INFO] at java.net.URL.openStream(URL.java:1045)
10.0.0.113 2017-10-12 10:28:33.661 STDERR Thread-1 [INFO] at java.util.ServiceLoader.parse(ServiceLoader.java:304)
10.0.0.113 2017-10-12 10:28:33.661 STDERR Thread-1 [INFO] ... 92 more