XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.95.2
    • 0.98.0, 0.96.1, 0.94.14
    • mapreduce
    • None
    • Reviewed
    • Hide
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration.

      This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055.
      Show
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration. This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055 .

    Description

      The way we support adding HBase dependencies to a MapReduce job in TableMapReduceUtils#addDependencyJars(job) is a bit monolithic. Advanced users need a way to add HBase and its dependencies to their job without us snooping around for ouput formats and the like (see PIG-3285). We can also benefit from a little more code reuse between our mapred and mapreduce namespaces.

      Attachments

        1. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          40 kB
          Nick Dimiduk
        2. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          40 kB
          Nick Dimiduk
        3. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          42 kB
          Nick Dimiduk
        4. HBASE-9165.02.patch
          40 kB
          Nick Dimiduk
        5. HBASE-9165-0.94.00.patch
          6 kB
          Nick Dimiduk
        6. HBASE-9165-0.94.01.patch
          6 kB
          Nick Dimiduk
        7. HBASE-9165-0.96.00.patch
          36 kB
          Nick Dimiduk

        Issue Links

          Activity

            People

              ndimiduk Nick Dimiduk
              ndimiduk Nick Dimiduk
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: