[HIVE-24702] HiveServer2 local task leaves token crc file never gets deleted

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: HiveServer2
• Assignee: Unassigned
• Reporter: dingshun
• Created: 29/Jan/21 06:33
• Updated: 29/Jan/21 06:43

Description

 in secure clusters, hiveserver2 creates a large number of  /tmp/.hive_hadoop_delegation_token*.tmp.crc files,  which related the Delegation Token and never gets deleted, when executes local tasks.

 

root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc
-rw-r--r-- 1 hive hadoop 12 Jun 28  2020 /tmp/.hive_hadoop_delegation_token990009534922436653.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Nov 13 19:08 /tmp/.hive_hadoop_delegation_token990009600555210260.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 11 11:07 /tmp/.hive_hadoop_delegation_token99002199141550942.tmp.crc
-rw-r--r-- 1 hive hadoop 16 Jan 28 05:50 /tmp/.hive_hadoop_delegation_token990029730478148481.tmp.crc

 
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token99*.tmp.crc|wc -l 
4880
root@hostname:~ # ls -l /tmp/.hive_hadoop_delegation_token*.tmp.crc|wc -l 
-bash: /bin/ls: Argument list too long 

 

It's created by SecureCmdDoAs  when the local task is executed

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L67

never gets deleted

https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java#L80