Hive
  1. Hive
  2. HIVE-6356

Dependency injection in hbase storage handler is broken

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: HBase Handler
    • Labels:
      None

      Description

      Dependent jars for hbase is not added to tmpjars, which is caused by the change of method signature(TableMapReduceUtil.addDependencyJars).

      1. HIVE-6356.1.patch.txt
        3 kB
        Navis
      2. HIVE-6356.2.patch.txt
        2 kB
        Navis
      3. HIVE-6356.3.patch.txt
        2 kB
        Navis
      4. HIVE-6356.4.patch.txt
        2 kB
        Xuefu Zhang
      5. HIVE-6356.4.patch.txt
        2 kB
        Xuefu Zhang
      6. HIVE-6356.addendum.00.patch
        3 kB
        Nick Dimiduk

        Issue Links

          Activity

          Xuefu Zhang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Xuefu Zhang made changes -
          Assignee Xuefu Zhang [ xuefuz ]
          Xuefu Zhang made changes -
          Attachment HIVE-6356.4.patch.txt [ 12631814 ]
          Xuefu Zhang made changes -
          Attachment HIVE-6356.4.patch.txt [ 12631340 ]
          Ashutosh Chauhan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Navis made changes -
          Comment [ In hbase-0.96.0, mapred.TableMapReduceUtil#addDependencyJars(JobConf) does not call "org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addHBaseDependencyJars(job)" which is not exist.

          {code}
          public static void addDependencyJars(JobConf job) throws IOException {
              org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(
                job,
                org.apache.zookeeper.ZooKeeper.class,
                org.jboss.netty.channel.ChannelFactory.class,
                com.google.common.base.Function.class,
                com.google.protobuf.Message.class,
                job.getMapOutputKeyClass(),
                job.getMapOutputValueClass(),
                job.getOutputKeyClass(),
                job.getOutputValueClass(),
                job.getPartitionerClass(),
                job.getClass("mapred.input.format.class", TextInputFormat.class, InputFormat.class),
                job.getClass("mapred.output.format.class", TextOutputFormat.class, OutputFormat.class),
                job.getCombinerClass());
            }
          {code}
          Again, this only
          bq. adds zookeeper, netty, guava, hadoop, hive-exec, hive-hbase-handler to tmpJars, missing hbase related classes. ]
          Navis made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Navis made changes -
          Assignee Navis [ navis ]
          Navis made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Navis made changes -
          Attachment HIVE-6356.3.patch.txt [ 12628643 ]
          Ashutosh Chauhan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6356.addendum.00.patch [ 12627374 ]
          Navis made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Ashutosh Chauhan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.13.0 [ 12324986 ]
          Resolution Fixed [ 1 ]
          Navis made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Navis made changes -
          Attachment HIVE-6356.2.patch.txt [ 12626785 ]
          Navis made changes -
          Link This issue is broken by HIVE-3603 [ HIVE-3603 ]
          Navis made changes -
          Link This issue is broken by HIVE-4388 [ HIVE-4388 ]
          Navis made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Navis made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Navis made changes -
          Attachment HIVE-6356.1.patch.txt [ 12626614 ]
          Navis made changes -
          Field Original Value New Value
          Link This issue is broken by HIVE-4388 [ HIVE-4388 ]
          Navis created issue -

            People

            • Assignee:
              Xuefu Zhang
              Reporter:
              Navis
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development