[DRILL-3720] Avro Record Reader should process Avro files by per block basis

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.1.0
• Fix Version/s: 1.2.0
• Component/s: Storage - Other
• Flags: Patch
• Assignee: Jacques Nadeau
• Reporter: Bhallamudi Venkata Siva Kamesh
• Created: 28/Aug/15 09:50
• Updated: 14/Sep/15 05:30
• Resolved: 14/Sep/15 05:30

Description

Currently Avro Record Reader processes entire file in single drill bit. This is fine as long as files are of size HDFS block size. However, if the size of the file is large, it causes a lot of performance issues.

To address this, Avro Record Reader should process Avro files by per block basis.