[CARBONDATA-3371] Compaction show ArrayIndexOutOfBoundsException after sort_columns modification

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.4
• Assignee: David Cai
• Reporter: David Cai
• Created: 05/May/19 07:41
• Updated: 09/May/19 11:00
• Resolved: 09/May/19 11:00

Description

2019-05-05 15:26:39 ERROR DataTypeUtil:619 - Cannot convert�
Z�w} to SHORT type valueWrong length: 8, expected 2
2019-05-05 15:26:39 ERROR DataTypeUtil:621 - Problem while converting data type�
Z�w}
2019-05-05 15:26:39 ERROR CompactionResultSortProcessor:185 - 3
java.lang.ArrayIndexOutOfBoundsException: 3
at org.apache.carbondata.core.scan.wrappers.ByteArrayWrapper.getNoDictionaryKeyByIndex(ByteArrayWrapper.java:81)
at org.apache.carbondata.processing.merger.CompactionResultSortProcessor.prepareRowObjectForSorting(CompactionResultSortProcessor.java:332)
at org.apache.carbondata.processing.merger.CompactionResultSortProcessor.processResult(CompactionResultSortProcessor.java:250)
at org.apache.carbondata.processing.merger.CompactionResultSortProcessor.execute(CompactionResultSortProcessor.java:175)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:226)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:82)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2019-05-05 15:26:39 ERROR CarbonMergerRDD:233 - Compaction Failed

Issue Links

• links to: GitHub Pull Request #3201