[SPARK-28260] Add CLOSED state to ExecutionState

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 05/Jul/19 14:57
• Updated: 26/Jul/19 15:47
• Resolved: 12/Jul/19 17:34

Description

Currently, the ThriftServerTab displays a FINISHED state when the operation finishes execution, but quite often it still takes a lot of time to fetch the results. OperationState has state CLOSED for when after the iterator is closed. Could we add CLOSED state to ExecutionState, and override the close() in SparkExecuteStatement / GetSchemas / GetTables / GetColumns to do HiveThriftServerListener.onOperationClosed?

 

https://github.com/apache/spark/pull/25043#issuecomment-508722874

Issue Links

• links to: GitHub Pull Request #25062