[ORC-676] Add getRawDataSizeFromColIndices back

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.7.0
• Fix Version/s: 1.6.6, 1.7.0
• Component/s: Java
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 27/Oct/20 05:10
• Updated: 10/Dec/20 23:36
• Resolved: 28/Oct/20 04:16

Description

[info] - Verify the ORC conversion parameter: CONVERT_METASTORE_ORC *** FAILED *** (1 second, 366 milliseconds)
[info]   java.lang.RuntimeException: ORC split generation failed with exception: java.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.io.orc.ReaderImpl.getRawDataSizeFromColIndices(Ljava/util/List;Ljava/util/List;Ljava/util/List;)J
[info]   at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:1731)
[info]   at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:1817)
[info]   at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:205)

Issue Links

• blocks: SPARK-33295 Upgrade ORC to 1.6.6
• links to: GitHub Pull Request #555