[SPARK-49333] Shutdown timeout thread while cleaning up SparkExecuteStatementOperation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0, 4.0.0
• Fix Version/s: 4.0.0, 3.5.3
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 21/Aug/24 08:57
• Updated: 26/Aug/24 02:02
• Resolved: 23/Aug/24 00:22

Description

/apache/java17/bin/jmap  -histo 398 | grep SparkExecuteStatementOperation

 308:          4127        1122544  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation
 563:          4127         363176  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$ErrRowCountType$
 876:          4127         132064  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$1
2101:           333           7992  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$5
3106:            32           1024  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2
3303:            32            768  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$3755/0x00000008021fe800
3304:            32            768  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$anon$2$$anon$3
3961:             9            360  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$5398/0x0000000802523900
3962:             9            360  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$5399/0x0000000802523bd8
20239:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$
20240:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$$Lambda$5397/0x000000080251e180
20241:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$11228/0x000000080306ba38
20242:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$11230/0x00000008032962d8
20243:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$11231/0x00000008032966b8
20244:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$5363/0x0000000802509470
20245:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$5367/0x000000080250a618
20246:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$6475/0x00000008026fda40
20247:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$7355/0x00000008028aa180
20248:             1             16  org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation$$Lambda$7356/0x00000008028aa560

Issue Links

• links to: GitHub Pull Request #47826