[CARBONDATA-1533] Fixed decimal data load fail issue and restricted max characters per column

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Manish Gupta
• Reporter: Manish Gupta
• Created: 28/Sep/17 11:45
• Updated: 10/Oct/17 02:39
• Resolved: 10/Oct/17 02:39

Description

1. Data load fails when both precision and data falls in integer range for decimal data type with exception as below:
17/09/28 16:36:28 ERROR CarbonFactDataHandlerColumnar: pool-20-thread-1 Error in producer
java.lang.RuntimeException: internal error: org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec[src type: DECIMAL, target type: INT, stats(org.apache.carbondata.core.datastore.page.statistics.PrimitivePageStatsCollector@2afaa54e)]
at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$3.encode(AdaptiveIntegralCodec.java:142)
at org.apache.carbondata.core.datastore.page.SafeDecimalColumnPage.convertValue(SafeDecimalColumnPage.java:209)
at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$1.encodeData(AdaptiveIntegralCodec.java:67)
at org.apache.carbondata.core.datastore.page.encoding.ColumnPageEncoder.encode(ColumnPageEncoder.java:57)
at org.apache.carbondata.processing.store.TablePage.encodeAndCompressMeasures(TablePage.java:284)
at org.apache.carbondata.processing.store.TablePage.encode(TablePage.java:269)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processDataRows(CarbonFactDataHandlerColumnar.java:350)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.access$500(CarbonFactDataHandlerColumnar.java:62)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:724)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:701)

2. Negative Array size exception is thrown when max characters per column is greater than Short max value during data load.

Issue Links

• links to: GitHub Pull Request #1395