[HIVE-18671] lock not released after Hive on Spark query was cancelled

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.2
• Fix Version/s: 2.4.0, 3.0.0
• Assignee: Yongzhi Chen
• Reporter: Yongzhi Chen
• Created: 09/Feb/18 18:34
• Updated: 30/Jul/18 16:19
• Resolved: 13/Feb/18 15:42

Description

When cancel the query is running on spark, the SparkJobMonitor can not return, therefore the locks hold by the query can not be released. When enable debug in log, you will see many log info as following:

2018-02-09 08:27:09,613 INFO org.apache.hadoop.hive.ql.exec.spark.status.SparkJobMonitor: [HiveServer2-Background-Pool: Thread-80]: state = CANCELLED
2018-02-09 08:27:10,613 INFO org.apache.hadoop.hive.ql.exec.spark.status.SparkJobMonitor: [HiveServer2-Background-Pool: Thread-80]: state = CANCELLED