[HIVE-2660] Need better exception handling in RCFile tolerate corruptions mode

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Query Processor
• Hadoop Flags: Reviewed
• Assignee: Ramkumar Vadali
• Reporter: Ramkumar Vadali
• Created: 16/Dec/11 07:47
• Updated: 30/Apr/12 21:12
• Resolved: 16/Dec/11 17:06

Description

The exception handling in nextKeyValueTolerateCorruptions treats IOException as follows:

• if EOFException, corrupt, can be tolerated
• If CheckSumException, corrupt, can be tolerated
• else not a corruption, re-throw

But the compression code can also throw IOException in case of corruption, which will get re-thrown in this case.

The correct way of handling IOException is:

• if BlockMissingException, re-throw.
• if not BlockMissingException -> corruption, can be tolerated