[IMPALA-1557] Using Kerberos for Impala will exhaust file descriptors

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Works for Me
• Affects Version/s: Impala 2.0
• Component/s: Clients
• Labels: impala kerberos shell
• Target Version: Impala 2.3.0
• Assignee: Martin Grund
• Reporter: Jerry Chuan
• Created: 01/Dec/14 08:42
• Updated: 28/Dec/15 17:43
• Resolved: 17/Aug/15 16:29

Description

After I trace file opened of process.
I found when using impala-shell, it opens kerberos replay cache files.
But when process was over, it didn't close the cache files.

The following information is extracted from command 'lsof':
impalad 5730 impala 226u REG 8,1 329 15926 /var/tmp/impala_984 (deleted)
impalad 5730 impala 227u REG 8,1 329 15926 /var/tmp/impala_984 (deleted)
impalad 5730 impala 228u REG 8,1 329 15926 /var/tmp/impala_984 (deleted)
impalad 5730 impala 229u REG 8,1 329 15926 /var/tmp/impala_984 (deleted)
impalad 5730 impala 230u REG 8,1 329 15926 /var/tmp/impala_984 (deleted)
impalad 5730 impala 231w REG 8,1 652 15927 /var/tmp/impala_984
impalad 5730 impala 232u REG 8,1 652 15927 /var/tmp/impala_984
impalad 5730 impala 233u REG 8,1 652 15927 /var/tmp/impala_984
impalad 5730 impala 234u REG 8,1 652 15927 /var/tmp/impala_984
impalad 5730 impala 235u REG 8,1 652 15927 /var/tmp/impala_984

This problem make file descriptors increasing gradually and crush impala system