Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.98.0, 0.96.1, 0.94.14
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration.

      This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055.
      Show
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration. This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055 .

      Description

      The way we support adding HBase dependencies to a MapReduce job in TableMapReduceUtils#addDependencyJars(job) is a bit monolithic. Advanced users need a way to add HBase and its dependencies to their job without us snooping around for ouput formats and the like (see PIG-3285). We can also benefit from a little more code reuse between our mapred and mapreduce namespaces.

        Attachments

        1. HBASE-9165-0.96.00.patch
          36 kB
          Nick Dimiduk
        2. HBASE-9165-0.94.01.patch
          6 kB
          Nick Dimiduk
        3. HBASE-9165-0.94.00.patch
          6 kB
          Nick Dimiduk
        4. HBASE-9165.02.patch
          40 kB
          Nick Dimiduk
        5. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          42 kB
          Nick Dimiduk
        6. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          40 kB
          Nick Dimiduk
        7. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
          40 kB
          Nick Dimiduk

          Issue Links

            Activity

              People

              • Assignee:
                ndimiduk Nick Dimiduk
                Reporter:
                ndimiduk Nick Dimiduk
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: