[MAPREDUCE-773] LineRecordReader can report non-zero progress while it is processing a compressed stream

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.21.0
• Component/s: task
• Hadoop Flags: Reviewed
• Release Note: Modifies LineRecordReader to report an approximate progress, instead of just returning 0, when using compressed streams.
• Assignee: Devaraj Das
• Reporter: Devaraj Das
• Created: 20/Jul/09 11:13
• Updated: 24/Aug/10 21:14
• Resolved: 18/Aug/09 08:55

Description

Currently, the LineRecordReader returns 0.0 from getProgress() for most inputs (since the "end" of the filesplit is set to Long.MAX_VALUE for compressed inputs). This can be improved to return a non-zero progress even for compressed streams (though it may not be very reflective of the actual progress).