[HIVE-18034] Improving logging with HoS executors spend lots of time in GC

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Spark
• Target Version/s: 3.0.0
• Assignee: Sahil Takiar
• Reporter: Sahil Takiar
• Created: 09/Nov/17 15:54
• Updated: 22/May/18 23:17
• Resolved: 14/Mar/18 17:03

Description

There are times when Spark will spend lots of time doing GC. The Spark History UI shows a bunch of red flags when too much time is spent in GC. It would be nice if those warnings are propagated to Hive.

Issue Links

• links to: RB