[IMPALA-1854] Impala may leak or use too many file descriptors

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 2.1
• Fix Version/s: Impala 2.2
• Labels: crash
• Assignee: Nong Li
• Reporter: Silvius Rus
• Created: 06/Mar/15 05:26
• Updated: 21/Mar/15 22:43
• Resolved: 06/Mar/15 05:27

Description

Impala may leak file descriptors if ScanRange::Open() fails due to an error seeking to the file offset.

Impala may keep file descriptors open longer than necessary. It may keep files open until the last buffer is returned, which can be arbitrarily long as the buffer is passed up the plan tree. This is unnecessary for the case where hdfs caching is not being used.