Hive
  1. Hive
  2. HIVE-2788

When integrating into MapReduce2, Hive is unable to handle corrupt rcfile archive

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc:

      [junit] Running org.apache.hadoop.hive.cli.TestCliDriver
      [junit] Begin query: archive_corrupt.q
      [junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
      [junit] Exception: Client Execution failed with error code = 9
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] at junit.framework.Assert.fail(Assert.java:50)
      [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      [junit] at java.lang.reflect.Method.invoke(Method.java:616)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
      [junit] at junit.framework.TestResult.run(TestResult.java:113)
      [junit] at junit.framework.TestCase.run(TestCase.java:124)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
      [junit] Cleaning up TestCliDriver
      [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
      [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
      [for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing this line:
      [for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing this line:
      [for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

      And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:

      PREHOOK: query: drop table tstsrcpart
      PREHOOK: type: DROPTABLE
      POSTHOOK: query: drop table tstsrcpart
      POSTHOOK: type: DROPTABLE
      PREHOOK: query: create table tstsrcpart like srcpart
      PREHOOK: type: CREATETABLE
      POSTHOOK: query: create table tstsrcpart like srcpart
      POSTHOOK: type: CREATETABLE
      POSTHOOK: Output: default@tstsrcpart
      PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11')
      PREHOOK: type: LOAD
      PREHOOK: Output: default@tstsrcpart
      Failed with exception Wrong file format. Please check the file's format.
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

      When running the following:
      load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11')

      Get exception:
      Failed with exception Wrong file format. Please check the file's format.
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

        Activity

        Hide
        Zhenxiao Luo added a comment -

        Fixed in HIVE-2979

        Show
        Zhenxiao Luo added a comment - Fixed in HIVE-2979
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          People

          • Assignee:
            Zhenxiao Luo
            Reporter:
            Zhenxiao Luo
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development