Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: Tests, Windows
    • Labels:
      None

      Description

      Test failed with error message:
      [junit] Task with the most failures(4):
      [junit] -----
      [junit] Task ID:
      [junit] task_20130814023904691_0001_m_000000
      [junit]
      [junit] URL:
      [junit] http://localhost:50030/taskdetails.jsp?jobid=job_20130814023904691_0001&tipid=task_20130814023904691_0001_m_000000
      [junit] -----
      [junit] Diagnostic Messages for this Task:
      [junit] java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row

      {"key":"238","value":"val_238"}

      [junit] at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:175)
      [junit] at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
      [junit] at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
      [junit] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:365)
      [junit] at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
      [junit] at java.security.AccessController.doPrivileged(Native Method)
      [junit] at javax.security.auth.Subject.doAs(Subject.java:396)
      [junit] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
      [junit] at org.apache.hadoop.mapred.Child.main(Child.java:265)
      [junit] Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row

      {"key":"238","value":"val_238"}

      [junit] at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:538)
      [junit] at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:157)
      [junit] ... 8 more
      [junit] Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: [Error 20000]: Unable to initialize custom script.
      [junit] at org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:357)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:848)
      [junit] at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:848)
      [junit] at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504)
      [junit] at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:848)
      [junit] at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:528)
      [junit] ... 9 more
      [junit] Caused by: java.io.IOException: Cannot run program "D:\tmp\hadoop-Administrator\mapred\local\3_0\taskTracker\Administrator\jobcache\job_20130814023904691_0001\attempt_20130814023904691_0001_m_000000_3\work\.\testgrep": CreateProcess error=193, %1 is not a valid Win32 application
      [junit] at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
      [junit] at org.apache.hadoop.hive.ql.exec.ScriptOperator.processOp(ScriptOperator.java:316)
      [junit] ... 18 more
      [junit] Caused by: java.io.IOException: CreateProcess error=193, %1 is not a valid Win32 application
      [junit] at java.lang.ProcessImpl.create(Native Method)
      [junit] at java.lang.ProcessImpl.<init>(ProcessImpl.java:81)
      [junit] at java.lang.ProcessImpl.start(ProcessImpl.java:30)
      [junit] at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
      [junit] ... 19 more
      [junit]
      [junit]
      [junit] Exception: Client Execution failed with error code = 20000
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 20000
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] at junit.framework.Assert.fail(Assert.java:47)
      [junit] at org.apache.hadoop.hive.cli.TestMinimrCliDriver.runTest(TestMinimrCliDriver.java:122)
      [junit] at org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_scriptfile1(TestMinimrCliDriver.java:104)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      [junit] at java.lang.reflect.Method.invoke(Method.java:597)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:154)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:127)
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
      [junit] at junit.framework.TestResult.run(TestResult.java:109)
      [junit] at junit.framework.TestCase.run(TestCase.java:118)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:203)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
      [junit] Failed query: scriptfile1.q

      1. HIVE-5086-2.patch
        7 kB
        Daniel Dai
      2. HIVE-5086-1.patch
        6 kB
        Daniel Dai

        Activity

        Hide
        Ashutosh Chauhan added a comment -

        +1

        Show
        Ashutosh Chauhan added a comment - +1
        Hide
        Ashutosh Chauhan added a comment -

        scriptfile1.q test failed for me with following trace:

          [junit] Running org.apache.hadoop.hive.cli.TestMinimrCliDriver
            [junit] Begin query: scriptfile1.q
            [junit] Exception: Client Execution failed with error code = 40000
            [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
            [junit] Failed query: scriptfile1.q
            [junit] NoViableAltException(213@[])
            [junit] 	at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:900)
            [junit] 	at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:190)
            [junit] 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
            [junit] 	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:342)
            [junit] 	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:977)
            [junit] 	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
            [junit] 	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
            [junit] 	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
            [junit] 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
            [junit] 	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:348)
            [junit] 	at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:795)
            [junit] 	at org.apache.hadoop.hive.cli.TestMinimrCliDriver.runTest(TestMinimrCliDriver.java:125)
            [junit] 	at org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_scriptfile1(TestMinimrCliDriver.java:105)
        
        Show
        Ashutosh Chauhan added a comment - scriptfile1.q test failed for me with following trace: [junit] Running org.apache.hadoop.hive.cli.TestMinimrCliDriver [junit] Begin query: scriptfile1.q [junit] Exception: Client Execution failed with error code = 40000 [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. [junit] Failed query: scriptfile1.q [junit] NoViableAltException(213@[]) [junit] at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:900) [junit] at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:190) [junit] at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) [junit] at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:342) [junit] at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:977) [junit] at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888) [junit] at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259) [junit] at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216) [junit] at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413) [junit] at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:348) [junit] at org.apache.hadoop.hive.ql.QTestUtil.executeClient(QTestUtil.java:795) [junit] at org.apache.hadoop.hive.cli.TestMinimrCliDriver.runTest(TestMinimrCliDriver.java:125) [junit] at org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_scriptfile1(TestMinimrCliDriver.java:105)
        Hide
        Daniel Dai added a comment -

        Fixed unit test failure.

        Show
        Daniel Dai added a comment - Fixed unit test failure.
        Hide
        Ashutosh Chauhan added a comment -

        Seems like scriptfile1_win.q is missing in latest patch.

        Show
        Ashutosh Chauhan added a comment - Seems like scriptfile1_win.q is missing in latest patch.
        Hide
        Ashutosh Chauhan added a comment -

        Nevermind, I found the missing file in original patch. Committed to trunk. Thanks, Daniel!

        Show
        Ashutosh Chauhan added a comment - Nevermind, I found the missing file in original patch. Committed to trunk. Thanks, Daniel!
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2 #442 (See https://builds.apache.org/job/Hive-trunk-hadoop2/442/)
        HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830)

        • /hive/trunk/build-common.xml
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out
        • /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2 #442 (See https://builds.apache.org/job/Hive-trunk-hadoop2/442/ ) HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830 ) /hive/trunk/build-common.xml /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-h0.21 #2343 (See https://builds.apache.org/job/Hive-trunk-h0.21/2343/)
        HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830)

        • /hive/trunk/build-common.xml
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out
        • /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-h0.21 #2343 (See https://builds.apache.org/job/Hive-trunk-h0.21/2343/ ) HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830 ) /hive/trunk/build-common.xml /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop2-ptest #107 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/107/)
        HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830)

        • /hive/trunk/build-common.xml
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out
        • /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop2-ptest #107 (See https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/107/ ) HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830 ) /hive/trunk/build-common.xml /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hive-trunk-hadoop1-ptest #174 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/174/)
        HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830)

        • /hive/trunk/build-common.xml
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q
        • /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out
        • /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out
        • /hive/trunk/ql/src/test/scripts/testgrep_win.bat
        Show
        Hudson added a comment - FAILURE: Integrated in Hive-trunk-hadoop1-ptest #174 (See https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/174/ ) HIVE-5086 : Fix scriptfile1.q on Windows (Daniel Dai via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1524830 ) /hive/trunk/build-common.xml /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1.q /hive/trunk/ql/src/test/queries/clientpositive/scriptfile1_win.q /hive/trunk/ql/src/test/results/clientpositive/scriptfile1.q.out /hive/trunk/ql/src/test/results/clientpositive/scriptfile1_win.q.out /hive/trunk/ql/src/test/scripts/testgrep_win.bat

          People

          • Assignee:
            Daniel Dai
            Reporter:
            Daniel Dai
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development