[GOBBLIN-412] Compression parameters are not propagated to Hadoop

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.11.0, 0.12.0, 0.13.0
• Fix Version/s: 0.13.0
• Component/s: gobblin-compaction
• Assignee: Issac Buenrostro
• Reporter: Sushant Pandey
• Created: 16/Feb/18 09:57
• Updated: 25/Jun/18 06:04
• Resolved: 15/Jun/18 16:04

Description

Parameters to control compression-

• mapreduce.output.fileoutputformat.compress
• mapreduce.output.fileoutputformat.compress.codec
• mapreduce.output.fileoutputformat.compress.type

are not passed on to Hadoop from compaction job configuration file. In effect, these parameter's value are always picked up from mapred-site.xml.