[SPARK-17553] On Master Change the running Apps goes to wait state even though resource are available

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 1.6.2
• Component/s: Spark Core, Web UI
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: vimal dinakaran
• Created: 15/Sep/16 09:03
• Updated: 21/May/19 04:36
• Resolved: 21/May/19 04:36

Description

When a zookeeper node goes down the master election changes and all the running apps are transferred to the new master. This works fine. But in the spark UI the app status goes to waiting state. The apps are actually running which can be seen in the streaming ui . But the master ui page it is shown as waiting. This is misleading.