Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10264

[MapReduce]: CompactionTool in mapred mode is missing classes in its classpath

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      Calling o.a.h.h.regionserver.CompactionTool fails due to classpath-related issues in both MRv1 and MRv2.

      hbase org.apache.hadoop.hbase.regionserver.CompactionTool -mapred -major hdfs://`hostname`:8020/hbase/data/default/orig_1388179858868

      Results:

      2013-12-27 13:31:49,478 INFO  [main] mapreduce.Job: Task Id : attempt_1388179525649_0011_m_000000_2, Status : FAILED
      Error: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.TableInfoMissingException
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      	at org.apache.hadoop.hbase.regionserver.CompactionTool$CompactionWorker.compact(CompactionTool.java:115)
      	at org.apache.hadoop.hbase.regionserver.CompactionTool$CompactionMapper.map(CompactionTool.java:231)
      	at org.apache.hadoop.hbase.regionserver.CompactionTool$CompactionMapper.map(CompactionTool.java:207)
      	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
      	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
      	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:165)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:415)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1499)
      	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:160)

        Attachments

        1. HBase-10264.patch
          1.0 kB
          Himanshu Vashishtha

          Activity

            People

            • Assignee:
              v.himanshu Himanshu Vashishtha
              Reporter:
              aleksshulman Aleksandr Shulman
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: