[HIVE-19249] Replication: WITH clause is not passing the configuration to Task correctly in all cases

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0, 3.0.0
• Fix Version/s: 3.0.0
• Component/s: repl
• Hadoop Flags: Reviewed
• Assignee: Vaibhav Gumashta
• Reporter: Vaibhav Gumashta
• Created: 19/Apr/18 18:37
• Updated: 22/May/18 23:15
• Resolved: 20/Apr/18 18:37

Description

When running repl load like following:

REPL LOAD `repldb_kms207` FROM 'hdfs://url:8020/apps/hive/repl/f8b057a7-c3f2-43bd-8baa-f7408a9008fc' WITH ('hive.exec.parallel'='true','hive.distcp.privileged.doAs'='beacon','hive.metastore.uris'='thrift://metastore-url:9083','hive.metastore.warehouse.dir'='s3a://s3-warehouse','hive.warehouse.subdir.inherit.perms'='false','hive.repl.replica.functions.root.dir'='s3a://s3-warehouse','fs.s3a.bucket.ss-datasets.endpoint'='s3-bucket-endpoint','fs.s3a.impl.disable.cache'='true','fs.s3a.server-side-encryption-algorithm'='SSE-KMS','fs.s3a.server-side-encryption.key'='encr-key','distcp.options.pp'='','distcp.options.pg'='','distcp.options.pu'='');

the task that get created need to use the configs that are passed in the USING clause. However, in some cases the wrong config object gets used.