[AVRO-2197] add a new constructor in DataFileReader & DataFileWriter with passing in Schema object

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.2
• Component/s: java
• Flags: Patch, Important
• Assignee: Unassigned
• Reporter: Howard Tong
• Created: 06/Jul/18 05:30
• Updated: 06/Jul/18 05:30

Description

When processing big number of small files (with the same schema header), reading/writing each file need to read/write the head and parsing the json script, which is very slow. 

If adding a new constructor in DataFileReader and DataFileWriter that allows pass in already parsed Schema object/script,  then it will greatly improve the reading/writing performance for such cases.