HBase
  1. HBase
  2. HBASE-1936

ClassLoader that loads from hdfs; useful adding filters to classpath without having to restart services

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.94.7, 0.95.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      With this patch, customer filters can be dropped into a pre-configured folder (hbase.dynamic.jars.dir), which can be in hdfs. Region servers can pick them up dynamically, no need to restart the cluster for the new filters to take effect.

      However, if a filter class is already loaded, it won't be un-loaded. Therefore, we can't load a new version of an existing class. Users have to have a proper way to do filter class versioning.
      Show
      With this patch, customer filters can be dropped into a pre-configured folder (hbase.dynamic.jars.dir), which can be in hdfs. Region servers can pick them up dynamically, no need to restart the cluster for the new filters to take effect. However, if a filter class is already loaded, it won't be un-loaded. Therefore, we can't load a new version of an existing class. Users have to have a proper way to do filter class versioning.
    1. cp_from_hdfs.patch
      28 kB
      stack
    2. HBASE-1936-trunk(forReview).patch
      32 kB
      Jieshan Bean
    3. trunk-1936.patch
      24 kB
      Jimmy Xiang
    4. trunk-1936_v2.patch
      25 kB
      Jimmy Xiang
    5. trunk-1936_v2.1.patch
      25 kB
      Jimmy Xiang
    6. trunk-1936_v2.2.patch
      23 kB
      Jimmy Xiang
    7. trunk-1936_v3.patch
      147 kB
      Jimmy Xiang
    8. 0.94-1936.patch
      29 kB
      Jimmy Xiang

      Issue Links

        Activity

        Andrew Purtell made changes -
        Labels noob
        Federico Gaule made changes -
        Link This issue relates to HBASE-10078 [ HBASE-10078 ]
        Jimmy Xiang made changes -
        Link This issue is related to HBASE-9532 [ HBASE-9532 ]
        Gavin made changes -
        Link This issue is depended upon by HBASE-1288 [ HBASE-1288 ]
        Gavin made changes -
        Link This issue blocks HBASE-1288 [ HBASE-1288 ]
        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Jimmy Xiang made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Fix Version/s 0.94.7 [ 12324039 ]
        Resolution Fixed [ 1 ]
        Jimmy Xiang made changes -
        Attachment 0.94-1936.patch [ 12578315 ]
        Jimmy Xiang made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Jimmy Xiang made changes -
        Link This issue is related to HBASE-8327 [ HBASE-8327 ]
        Jimmy Xiang made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Release Note With this patch, customer filters can be dropped into a pre-configured folder (hbase.dynamic.jars.dir), which can be in hdfs. Region servers can pick them up dynamically, no need to restart the cluster for the new filters to take effect.

        However, if a filter class is already loaded, it won't be un-loaded. Therefore, we can't load a new version of an existing class. Users have to have a proper way to do filter class versioning.
        Resolution Fixed [ 1 ]
        Jimmy Xiang made changes -
        Attachment trunk-1936_v3.patch [ 12578254 ]
        Jimmy Xiang made changes -
        Attachment trunk-1936_v2.2.patch [ 12578243 ]
        Jimmy Xiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jimmy Xiang made changes -
        Attachment trunk-1936_v2.1.patch [ 12578048 ]
        Jimmy Xiang made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jimmy Xiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.98.0 [ 12323143 ]
        Fix Version/s 0.95.1 [ 12324288 ]
        Jimmy Xiang made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Jimmy Xiang made changes -
        Attachment trunk-1936_v2.patch [ 12578014 ]
        Jimmy Xiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jimmy Xiang made changes -
        Attachment trunk-1936.patch [ 12577652 ]
        Jimmy Xiang made changes -
        Assignee Jimmy Xiang [ jxiang ]
        Jieshan Bean made changes -
        Assignee Jieshan Bean [ jeason ]
        Jonathan Hsieh made changes -
        Link This issue is related to HBASE-6527 [ HBASE-6527 ]
        Jieshan Bean made changes -
        Attachment HBASE-1936-trunk(forReview).patch [ 12522562 ]
        Jieshan Bean made changes -
        Attachment HBASE-1936-trunk.txt [ 12522561 ]
        Jieshan Bean made changes -
        Attachment HBASE-1936-trunk.txt [ 12522561 ]
        Jieshan Bean made changes -
        Assignee Jieshan Bean [ jeason ]
        Daniel Ploeg made changes -
        Assignee Daniel Ploeg [ dploeg ]
        Andrew Purtell made changes -
        Link This issue is depended upon by HBASE-2000 [ HBASE-2000 ]
        Daniel Ploeg made changes -
        Assignee Daniel Ploeg [ dploeg ]
        Jonathan Gray made changes -
        Labels noob
        Andrew Purtell made changes -
        Link This issue is depended upon by HBASE-2001 [ HBASE-2001 ]
        Andrew Purtell made changes -
        Link This issue is depended upon by HBASE-2001 [ HBASE-2001 ]
        Andrew Purtell made changes -
        Link This issue is depended upon by HBASE-2000 [ HBASE-2000 ]
        Jonathan Gray made changes -
        Link This issue blocks HBASE-1288 [ HBASE-1288 ]
        stack made changes -
        Field Original Value New Value
        Attachment cp_from_hdfs.patch [ 12423167 ]
        stack created issue -

          People

          • Assignee:
            Jimmy Xiang
            Reporter:
            stack
          • Votes:
            2 Vote for this issue
            Watchers:
            22 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development