Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2788

When integrating into MapReduce2, Hive is unable to handle corrupt rcfile archive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.10.0
    • None
    • None

    Description

      archive_corrupt.q is failing due to file format exception when loading archive_corrupt.rc:

      [junit] Running org.apache.hadoop.hive.cli.TestCliDriver
      [junit] Begin query: archive_corrupt.q
      [junit] Copying file: file:/home/cloudera/Code/hive/data/files/archive_corrupt.rc
      [junit] Exception: Client Execution failed with error code = 9
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] junit.framework.AssertionFailedError: Client Execution failed with error code = 9
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.
      [junit] at junit.framework.Assert.fail(Assert.java:50)
      [junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_corrupt(TestCliDriver.java:109)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      [junit] at java.lang.reflect.Method.invoke(Method.java:616)
      [junit] at junit.framework.TestCase.runTest(TestCase.java:168)
      [junit] at junit.framework.TestCase.runBare(TestCase.java:134)
      [junit] at junit.framework.TestResult$1.protect(TestResult.java:110)
      [junit] at junit.framework.TestResult.runProtected(TestResult.java:128)
      [junit] at junit.framework.TestResult.run(TestResult.java:113)
      [junit] at junit.framework.TestCase.run(TestCase.java:124)
      [junit] at junit.framework.TestSuite.runTest(TestSuite.java:243)
      [junit] at junit.framework.TestSuite.run(TestSuite.java:238)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
      [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
      [junit] See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs.)
      [junit] Cleaning up TestCliDriver
      [junit] Tests run: 2, Failures: 1, Errors: 0, Time elapsed: 6.778 sec
      [junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
      [for] /home/cloudera/Code/hive/ql/build.xml: The following error occurred while executing this line:
      [for] /home/cloudera/Code/hive/build.xml:328: The following error occurred while executing this line:
      [for] /home/cloudera/Code/hive/build-common.xml:453: Tests failed!

      And, in /build/ql/test/logs/clientpositive/archive_corrupt.q.out:

      PREHOOK: query: drop table tstsrcpart
      PREHOOK: type: DROPTABLE
      POSTHOOK: query: drop table tstsrcpart
      POSTHOOK: type: DROPTABLE
      PREHOOK: query: create table tstsrcpart like srcpart
      PREHOOK: type: CREATETABLE
      POSTHOOK: query: create table tstsrcpart like srcpart
      POSTHOOK: type: CREATETABLE
      POSTHOOK: Output: default@tstsrcpart
      PREHOOK: query: load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11')
      PREHOOK: type: LOAD
      PREHOOK: Output: default@tstsrcpart
      Failed with exception Wrong file format. Please check the file's format.
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

      When running the following:
      load data local inpath '../data/files/archive_corrupt.rc' overwrite into table tstsrcpart partition (ds='2008-04-08', hr='11')

      Get exception:
      Failed with exception Wrong file format. Please check the file's format.
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

      Attachments

        Activity

          People

            zhenxiao Zhenxiao Luo
            zhenxiao Zhenxiao Luo
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: