Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14548

Expand how table coprocessor jar and dependency path can be specified

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.4.0, 0.98.21, 2.0.0
    • Component/s: Coprocessors
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Allow a directory containing the jars or some wildcards to be specified, such as: hdfs://namenode:port/user/hadoop-user/
      or
      hdfs://namenode:port/user/hadoop-user/*.jar

      Please note that if a directory is specified, all jar files(.jar) directly in the directory are added, but it does not search files in the subtree rooted in the directory.
      Do not contain any wildcard if you would like to specify a directory.
      Show
      Allow a directory containing the jars or some wildcards to be specified, such as: hdfs://namenode:port/user/hadoop-user/ or hdfs://namenode:port/user/hadoop-user/*.jar Please note that if a directory is specified, all jar files(.jar) directly in the directory are added, but it does not search files in the subtree rooted in the directory. Do not contain any wildcard if you would like to specify a directory.

      Description

      Currently you can specify the location of the coprocessor jar in the table coprocessor attribute.
      The problem is that it only allows you to specify one jar that implements the coprocessor. You will need to either bundle all the dependencies into this jar, or you will need to copy the dependencies into HBase lib dir.
      The first option may not be ideal sometimes. The second choice can be troublesome too, particularly when the hbase region sever node and dirs are dynamically added/created.

      There are a couple things we can expand here. We can allow the coprocessor attribute to specify a directory location, probably on hdfs.
      We may even allow some wildcard in there.

        Attachments

        1. HBASE-14548-1.2.0-v0.patch
          4 kB
          Xiang Li
        2. HBASE-14548-1.2.0-v1.patch
          8 kB
          Xiang Li
        3. HBASE-14548-master-v1.patch
          9 kB
          Xiang Li
        4. HBASE-14548-1.2.0-v2.patch
          9 kB
          Xiang Li
        5. HBASE-14548-master-v2.patch
          9 kB
          Xiang Li
        6. HBASE-14548-branch-1-v2.patch
          8 kB
          Jerry He

          Issue Links

            Activity

              People

              • Assignee:
                xiangli Xiang Li
                Reporter:
                jinghe Jerry He
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: