Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-315

Data loading fails if parsing a double value returns infinity

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.1.0-incubating, 0.2.0-incubating
    • 0.2.0-incubating
    • None
    • None

    Description

      During data load, if a value specified is too big for a double DataType column then while parsing that value as double result is returned as "Infinity". Due to this while we calculate min and max value for measures in carbon data writer step it throws an exception.

      ERROR 13-10 15:27:56,968 - [t3: Graph - MDKeyGent3][partitionID:0] org.apache.carbondata.processing.store.writer.exception.CarbonDataWriterException
      java.util.concurrent.ExecutionException: org.apache.carbondata.processing.store.writer.exception.CarbonDataWriterException
      at java.util.concurrent.FutureTask.report(FutureTask.java:122)
      at java.util.concurrent.FutureTask.get(FutureTask.java:188)
      at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:812)
      at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.finish(CarbonFactDataHandlerColumnar.java:779)
      at org.apache.carbondata.processing.mdkeygen.MDKeyGenStep.processRow(MDKeyGenStep.java:222)
      at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.carbondata.processing.store.writer.exception.CarbonDataWriterException
      at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:1244)
      at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:1215)
      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      ... 1 more

      Attachments

        Issue Links

          Activity

            People

              manishgupta_88 Manish Gupta
              manishgupta_88 Manish Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: