Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1596

UT fail, due to String encoding CharsetEncoder mismatch

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • v1.5.2
    • v1.5.2
    • Tools, Build and Test
    • None

    Description

      InvertedIndexLocalTest build dictionary using the platform's default charset for String encoding which is unsure, however, in getIdFromValueImpl of TrieDictionary using UTF, which cause the mismatch, as follow
      2016-04-18 18:03:39,903 ERROR [main] dict.TrieDictionary:173 : Not a valid value: 英国

      java.lang.IllegalArgumentException: Value not exists!
      at org.apache.kylin.dimension.Dictionary.getIdFromValueBytes(Dictionary.java:160)
      at org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:158)
      at org.apache.kylin.dimension.Dictionary.getIdFromValue(Dictionary.java:96)
      at org.apache.kylin.dimension.Dictionary.getIdFromValue(Dictionary.java:76)
      at org.apache.kylin.invertedindex.index.TableRecord.setValueString(TableRecord.java:116)
      at org.apache.kylin.invertedindex.InvertedIndexLocalTest.loadRecordsSorted(InvertedIndexLocalTest.java:187)
      at org.apache.kylin.invertedindex.InvertedIndexLocalTest.testCodec(InvertedIndexLocalTest.java:133)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
      at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
      at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
      at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
      at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
      at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
      at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
      at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
      at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
      at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
      at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
      at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
      at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:78)
      at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:212)
      at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:68)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)

      Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0

      Attachments

        Activity

          People

            whenwin wangxianbin
            whenwin wangxianbin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: