[IMPALA-5909] File handle cache causes HDFS to log excessive errors when trying to unbuffer files

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.10.0
• Fix Version/s: Impala 2.12.0
• Component/s: Backend
• Labels: usability
• Epic Color: ghx-label-1
• Assignee: Joe McDonnell
• Reporter: Tim Armstrong
• Created: 07/Sep/17 20:04
• Updated: 12/Feb/18 19:58
• Resolved: 12/Feb/18 19:57

Description

On a few different clusters I've seen a lot of errors like this in the logs:

org/apache/hadoop/fs/FSDataInputStream#unbuffer failed: error:
UnsupportedOperationException: this stream does not support unbuffering.java.lang.UnsupportedOperationException: this stream does not support unbuffering.
        at org.apache.hadoop.fs.FSDataInputStream.unbuffer(FSDataInputStream.java:233)

It doesn't seem harmful but adds a lot of noise to the logs for a non-error condition.

Issue Links

• is related to: HADOOP-14872 CryptoInputStream should implement unbuffer
• is related to: HADOOP-14864 FSDataInputStream#unbuffer UOE should include stream class name