[HIVE-21035] Race condition in SparkUtilities#getSparkSession

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Spark
• Assignee: Antal Sinkovits
• Reporter: Antal Sinkovits
• Created: 12/Dec/18 14:21
• Updated: 17/Nov/22 08:54
• Resolved: 14/Dec/18 13:23

Description

It can happen, that when in one given session, multiple queries are executed, that due to a race condition, multiple spark application master gets kicked off.
In this case, the one that started earlier, will not be killed, when the hive session closes, consuming resources.