Hive
  1. Hive
  2. HIVE-6962

NoSuchMethodError exception when using HIVE 0.13 with Hadoop 1.0.4

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.13.0
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None
    • Environment:

      Hadoop 1.0.4

      Description

      Use HIVE 0.13 with Hadoop 1.0.4. When executing a query, get the following exception:

      Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.unset(Ljava/lang/String;)V
      	at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3416)
      	at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3401)
      	at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:214)
      	at org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:265)
      	at org.apache.hadoop.hive.ql.Context.getMRTmpPath(Context.java:323)
      	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1442)
      	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1192)
      	at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9209)
      	at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:391)
      	at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:291)
      	at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:944)
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1009)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:880)
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:870)
      	at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
      	at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
      	at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
      	at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
      	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
      	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
      

      This is because there is no unset() method in some versions of Hadoop.

        Issue Links

          Activity

          Thejas M Nair made changes -
          Link This issue is related to HIVE-7001 [ HIVE-7001 ]
          Sun Rui made changes -
          Link This issue is related to HIVE-6782 [ HIVE-6782 ]
          Sun Rui made changes -
          Field Original Value New Value
          Description Use HIVE 0.13 with Hadoop 1.0.4. When executing a query, get the following exception:
          Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.unset(Ljava/lang/String;)V
          at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3416)
          at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3401)
          at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:214)
          at org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:265)
          at org.apache.hadoop.hive.ql.Context.getMRTmpPath(Context.java:323)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1442)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1192)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9209)
          at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
          at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:391)
          at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:291)
          at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:944)
          at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1009)
          at org.apache.hadoop.hive.ql.Driver.run(Driver.java:880)
          at org.apache.hadoop.hive.ql.Driver.run(Driver.java:870)
          at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
          at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
          at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
          at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
          at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
          at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

          This is because there is no unset() method in some versions of Hadoop.
          Use HIVE 0.13 with Hadoop 1.0.4. When executing a query, get the following exception:

          {noformat}
          Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.conf.Configuration.unset(Ljava/lang/String;)V
          at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3416)
          at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3401)
          at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:214)
          at org.apache.hadoop.hive.ql.Context.getMRScratchDir(Context.java:265)
          at org.apache.hadoop.hive.ql.Context.getMRTmpPath(Context.java:323)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1442)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.getMetaData(SemanticAnalyzer.java:1192)
          at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9209)
          at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
          at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:391)
          at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:291)
          at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:944)
          at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1009)
          at org.apache.hadoop.hive.ql.Driver.run(Driver.java:880)
          at org.apache.hadoop.hive.ql.Driver.run(Driver.java:870)
          at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
          at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
          at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
          at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
          at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
          at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
          at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
          at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          at java.lang.reflect.Method.invoke(Method.java:597)
          at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
          {noformat}

          This is because there is no unset() method in some versions of Hadoop.
          Sun Rui created issue -

            People

            • Assignee:
              Unassigned
              Reporter:
              Sun Rui
            • Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development