Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.98.0, 0.96.1, 0.94.14
    • Component/s: mapreduce
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration.

      This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055.
      Show
      Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration. This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055 .

      Description

      The way we support adding HBase dependencies to a MapReduce job in TableMapReduceUtils#addDependencyJars(job) is a bit monolithic. Advanced users need a way to add HBase and its dependencies to their job without us snooping around for ouput formats and the like (see PIG-3285). We can also benefit from a little more code reuse between our mapred and mapreduce namespaces.

      1. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
        42 kB
        Nick Dimiduk
      2. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
        40 kB
        Nick Dimiduk
      3. 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch
        40 kB
        Nick Dimiduk
      4. HBASE-9165-0.94.00.patch
        6 kB
        Nick Dimiduk
      5. HBASE-9165.02.patch
        40 kB
        Nick Dimiduk
      6. HBASE-9165-0.96.00.patch
        36 kB
        Nick Dimiduk
      7. HBASE-9165-0.94.01.patch
        6 kB
        Nick Dimiduk

        Issue Links

          Activity

          Nick Dimiduk created issue -
          Nick Dimiduk made changes -
          Field Original Value New Value
          Attachment 0001-HBASE-9165-mapreduce-Modularize-building-dependency-.patch [ 12596999 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.98.0 [ 12323143 ]
          Fix Version/s 0.96.1 [ 12324961 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hadoop Flags Reviewed [ 10343 ]
          Nick Dimiduk made changes -
          Attachment HBASE-9165-0.94.00.patch [ 12613968 ]
          Nick Dimiduk made changes -
          Fix Version/s 0.94.14 [ 12325047 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Attachment HBASE-9165.02.patch [ 12613983 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Attachment HBASE-9165-0.96.00.patch [ 12614091 ]
          Nick Dimiduk made changes -
          Link This issue is related to HBASE-9484 [ HBASE-9484 ]
          Nick Dimiduk made changes -
          Link This issue is related to HBASE-9112 [ HBASE-9112 ]
          Nick Dimiduk made changes -
          Attachment HBASE-9165-0.94.01.patch [ 12614123 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note Introduces the method TableMapReduceUtil#addHBaseDependencyJars for adding HBase and its direct dependencies (only) to the job configuration.

          This is intended as a low-level API, facilitating code reuse between this class and its mapred counterpart. It is also of use to external tools that need to build a MapReduce job that interacts with HBase but want fine-grained control over the jars shipped to the cluster. See also PIG-3285 and HIVE-2055.
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Nick Dimiduk
              Reporter:
              Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development