Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5088

Fix udf_translate.q on Windows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • 0.13.0
    • Tests, Windows
    • None

    Description

      Test failed with message:
      [junit] Begin query: udf_translate.q
      [junit] 13/08/14 03:23:57 FATAL conf.Configuration: error parsing conf file: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: Invalid byte 1 of 1-byte UTF-8 sequence.
      [junit] Exception in thread "main" java.lang.RuntimeException: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: Invalid byte 1 of 1-byte UTF-8 sequence.
      [junit] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1255)
      [junit] at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1117)
      [junit] at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1053)
      [junit] at org.apache.hadoop.conf.Configuration.get(Configuration.java:397)
      [junit] at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:594)
      [junit] at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1015)
      [junit] at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:659)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      [junit] at java.lang.reflect.Method.invoke(Method.java:597)
      [junit] at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
      [junit] Caused by: com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: Invalid byte 1 of 1-byte UTF-8 sequence.
      [junit] at com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.invalidByte(UTF8Reader.java:684)
      [junit] at com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.read(UTF8Reader.java:554)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.load(XMLEntityScanner.java:1742)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.peekChar(XMLEntityScanner.java:487)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2688)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:647)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:140)
      [junit] at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:511)
      [junit] at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:808)
      [junit] at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
      [junit] at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
      [junit] at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:232)
      [junit] at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:284)
      [junit] at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:124)
      [junit] at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181)
      [junit] ... 11 more
      [junit] Exception: Client Execution failed with error code = 1
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 1
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] at junit.framework.Assert.fail(Assert.java:47)
      [junit] at org.apache.hadoop.hive.cli.TestCliDriver.runTest(TestCliDriver.java:122)
      [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_translate(TestCliDriver.java:104)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      [junit] at java.lang.reflect.Method.invoke(Method.java:597)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:154)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:127)
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
      [junit] at junit.framework.TestResult.run(TestResult.java:109)
      [junit] at junit.framework.TestCase.run(TestCase.java:118)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:203)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
      [junit] Failed query: udf_translate.q

      Whether or not get exception is environment dependent. But even no exception thrown, we still get wrong characters written to job.conf.

      There is a similar bug on Hadoop side: HADOOP-9801

      Attachments

        1. HIVE-5088-1.patch
          0.9 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: