[GOBBLIN-1318] Apache Parquet breaks HiveWriteAbleHdfsDataWriter

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.15.0
• Component/s: gobblin-core
• Assignee: Abhishek Tiwari
• Reporter: William Lo
• Created: 14/Nov/20 00:43
• Updated: 14/Nov/20 00:44

Description

HiveOutputFormat in org.apache.hadoop.hive.ql.io, does not have `parquet/hadoop/api/WriteSupport` , causing `HiveWritableHdfsDataWriter` to break.
In https://issues.apache.org/jira/browse/HIVE-11096 the fix is added in version 2.0

Attempts to resolve this by using hive-exec 2.0.0 results in `java.lang.IncompatibleClassChangeError` and other compile time issues, so for now the solution will be to disable the integration test in `WriterOutputFormatIntegrationTest.parquetOutputFormatTest()`