Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15152

Automatically include prefix-tree module in MR jobs if present

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      I was running some MR jobs tests and ended up with PrefixTreeCodec class not found in the YarnChildren processes.

      2016-01-21 06:24:26,844 WARN  [main] mapreduce.TableMapReduceUtil(785): The  hbase-prefix-tree module jar containing PrefixTreeCodec is not present.
      java.lang.ClassNotFoundException: org.apache.hadoop.hbase.code.prefixtree.PrefixTreeCodec
              at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
              at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
      

      This is related to HBASE-7434 and HBASE-7936 which address compile time concerns. This fix makes it so that jar inclusion is done at run time, and continues if it is not present (for mr unit tests that don't depend on it)

      Attachments

        1. hbase-15152.patch
          3 kB
          Jonathan Hsieh

        Activity

          People

            jmhsieh Jonathan Hsieh
            jmhsieh Jonathan Hsieh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: