[HIVE-18460] Compactor doesn't pass Table properties to the Orc writer

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.13.0
• Component/s: Transactions
• Target Version/s: 3.0.0
• Assignee: Eugene Koifman
• Reporter: Eugene Koifman
• Created: 16/Jan/18 21:55
• Updated: 24/Nov/20 22:09
• Resolved: 18/Jan/18 17:21

Description

 

 CompactorMap.getWrite()/getDeleteEventWriter() both do AcidOutputFormat.Options.tableProperties() but
OrcOutputFormat.getRawRecordWriter() does

final OrcFile.WriterOptions opts =
OrcFile.writerOptions(options.getConfiguration());

which ignores tableProperties value.
It should do

final OrcFile.WriterOptions opts =
OrcFile.writerOptions(options.getTableProperties(), options.getConfiguration());

Issue Links

• breaks: HIVE-13354 Add ability to specify Compaction options per table and per request
• is caused by: HIVE-6060 Define API for RecordUpdater and UpdateReader
• relates to: HIVE-13563 Hive Streaming does not honor orc.compress.size and orc.stripe.size table properties