Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15152

Automatically include prefix-tree module in MR jobs if present

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      I was running some MR jobs tests and ended up with PrefixTreeCodec class not found in the YarnChildren processes.

      2016-01-21 06:24:26,844 WARN  [main] mapreduce.TableMapReduceUtil(785): The  hbase-prefix-tree module jar containing PrefixTreeCodec is not present.
      java.lang.ClassNotFoundException: org.apache.hadoop.hbase.code.prefixtree.PrefixTreeCodec
              at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
              at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
      

      This is related to HBASE-7434 and HBASE-7936 which address compile time concerns. This fix makes it so that jar inclusion is done at run time, and continues if it is not present (for mr unit tests that don't depend on it)

        Attachments

        1. hbase-15152.patch
          3 kB
          Jonathan Hsieh

          Activity

            People

            • Assignee:
              jmhsieh Jonathan Hsieh
              Reporter:
              jmhsieh Jonathan Hsieh
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: