[HIVE-12498] ACID: Setting OrcRecordUpdater.OrcOptions.tableProperties() has no effect

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 2.0.0
• Fix Version/s: 1.3.0, 2.0.0
• Labels: ACID ORC
• Target Version/s: 1.3.0, 2.0.0
• Assignee: Prasanth Jayachandran
• Reporter: Prasanth Jayachandran
• Created: 23/Nov/15 21:33
• Updated: 01/Oct/19 22:07
• Resolved: 25/Nov/15 19:49

Description

OrcRecordUpdater does not honor the OrcRecordUpdater.OrcOptions.tableProperties() setting.
It would need to translate the specified tableProperties (as listed in OrcTableProperties enum) to the properties that OrcWriter internally understands (listed in HiveConf.ConfVars).

This is needed for multiple clients.. like Streaming API and Compactor.

    Properties orcTblProps = ..   // get Orc Table Properties from MetaStore;
    AcidOutputFormat.Options updaterOptions =   new OrcRecordUpdater.OrcOptions(conf)
                                                     .inspector(..)
                                                     .bucket(..)
                                                     .minimumTransactionId(..)
                                                     .maximumTransactionId(..)
                                                     .tableProperties(orcTblProps); // <<== 
    OrcOutputFormat orcOutput =   new ...
    orcOutput.getRecordUpdater(partitionPath, updaterOptions );

Issue Links

• is related to: HIVE-13563 Hive Streaming does not honor orc.compress.size and orc.stripe.size table properties