Details
Description
OrcRecordUpdater does not honor the OrcRecordUpdater.OrcOptions.tableProperties() setting.
It would need to translate the specified tableProperties (as listed in OrcTableProperties enum) to the properties that OrcWriter internally understands (listed in HiveConf.ConfVars).
This is needed for multiple clients.. like Streaming API and Compactor.
Properties orcTblProps = .. // get Orc Table Properties from MetaStore; AcidOutputFormat.Options updaterOptions = new OrcRecordUpdater.OrcOptions(conf) .inspector(..) .bucket(..) .minimumTransactionId(..) .maximumTransactionId(..) .tableProperties(orcTblProps); // <<== OrcOutputFormat orcOutput = new ... orcOutput.getRecordUpdater(partitionPath, updaterOptions );
Attachments
Attachments
Issue Links
- is related to
-
HIVE-13563 Hive Streaming does not honor orc.compress.size and orc.stripe.size table properties
- Closed