[HIVE-6759] Fix reading partial ORC files while they are being written

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Assignee: Owen O'Malley
• Reporter: Owen O'Malley
• Created: 26/Mar/14 22:34
• Updated: 08/Apr/14 18:41
• Resolved: 08/Apr/14 18:41

Description

HDFS with the hflush ensures the bytes are visible, but doesn't update the file length on the NameNode. Currently the Orc reader will only read up to the length on the NameNode. If the user specified a length from a flush_length file, the Orc reader should trust it to be right.