[HIVE-9067] OrcFileMergeOperator may create merge file that does not match properties of input files

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.14.0, 0.14.1, 0.15.0
• Fix Version/s: 1.0.0
• Labels: Orc
• Assignee: Prasanth Jayachandran Assign to me
• Reporter: Prasanth Jayachandran
• Created: 10/Dec/14 21:43
• Updated: 29/Sep/15 06:21
• Resolved: 15/Dec/14 23:32

Description

OrcFileMergeOperator creates a new ORC file and appends the stripes from smaller orc file. This new ORC file creation should retain the same configuration as the small ORC files. Currently it does not set the orc row index stride and file version. Also merging of stripe statistics to file statistics was incorrect leading to issues like in HIVE-9080

Issue Links

• is related to: HIVE-9080 ORC Concatenate fails on: Column has wrong number of index entries found: 0 expected: 1
• links to: Review Board