[STORM-2324] Topology should not fail if topology jar is missing resources directory

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0, 1.1.0, 1.0.3
• Epic Link: Release Apache Storm 1.1.0
• Assignee: Roshan Naik
• Reporter: Roshan Naik
• Created: 25/Jan/17 04:15
• Updated: 24/Aug/17 05:46
• Resolved: 03/Feb/17 02:25

Description

Since Storm 1.0, due to STORM-876,
When the topo jar does not contain a resources directory, the topology fails if

supervisor.run.worker.as.user : true

Assessment:
After unpacking the topo jar file, supervisor.clj establishes a symlink to the resources directory without checking if the topology jar actually had a resources directory. This leads to a broken symlink.

Subsequently when the worker-launcher tool runs and tries to chmod the resources dir, it fails. This stalls the topology execution.

2017-01-17 15:48:12.413 o.a.s.d.supervisor [INFO] Running as user:xyz-admin command:("/usr/hdp/2.5.3.0-37/storm/bin/worker-launcher" "xyz-admin" "worker" "/apps/hadoop/storm/workers/46911423-af41-4db3-8480-7a95df96632a" "/apps/hadoop/storm/workers/46911423-af41-4db3-8480-7a95df96632a/storm-worker-script.sh")
2017-01-17 15:48:12.417 o.a.s.d.supervisor [INFO] 46911423-af41-4db3-8480-7a95df96632a still hasn't started
2017-01-17 15:48:12.418 o.a.s.util [WARN] Worker Process 46911423-af41-4db3-8480-7a95df96632a:main : command provided worker
2017-01-17 15:48:12.426 o.a.s.util [WARN] Worker Process 46911423-af41-4db3-8480-7a95df96632a:main : user is xyz-admin
2017-01-17 15:48:12.426 o.a.s.util [WARN] Worker Process 46911423-af41-4db3-8480-7a95df96632a:Failure to exec app initialization process - No such file or directory

Issue Links

• duplicates: STORM-2055 Exception when running topology from Maven exec with Flux
• relates to: STORM-2055 Exception when running topology from Maven exec with Flux
• links to: GitHub Pull Request #1908