[FLINK-18682] Vector orc reader cannot read Hive 2.0.0 table

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.11.1
• Fix Version/s: 1.11.2
• Component/s: Connectors / Hive, Formats (JSON, Avro, Parquet, ORC, SequenceFile)
• Labels: pull-request-available
• Assignee: Rui Li
• Reporter: Rui Li
• Created: 23/Jul/20 09:07
• Updated: 12/Aug/20 07:31
• Resolved: 12/Aug/20 07:31

Description

Trying to read a Hive 2.0.0 ORC table fails with:

Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/ql/exec/vector/TimestampColumnVector
	at org.apache.flink.orc.OrcSplitReaderUtil.lambda$genPartColumnarRowReader$0(OrcSplitReaderUtil.java:83)
	at org.apache.flink.orc.OrcColumnarRowSplitReader.<init>(OrcColumnarRowSplitReader.java:65)
	at org.apache.flink.orc.OrcSplitReaderUtil.genPartColumnarRowReader(OrcSplitReaderUtil.java:91)
	at org.apache.flink.connectors.hive.read.HiveVectorizedOrcSplitReader.<init>(HiveVectorizedOrcSplitReader.java:78)
	at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:137)
	at org.apache.flink.connectors.hive.read.HiveTableInputFormat.open(HiveTableInputFormat.java:66)
	at org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction.run(InputFormatSourceFunction.java:85)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:100)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:63)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:201)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.exec.vector.TimestampColumnVector
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 10 more

Issue Links

• links to: GitHub Pull Request #12985