HBase
  1. HBase
  2. HBASE-5305

Improve cross-version compatibility & upgradeability

    Details

    • Tags:
      0.96notable

      Description

      Raising an umbrella jira to address the RPC/Data compatibility & HBase upgradeability issues recently raised in the dev@ mailing list (am referring to the thread where one such message is http://bit.ly/wxl9Dy). I'll add some high level sub-tasks to this issue. Please feel free to add more.

        Issue Links

        1.
        Add support for protocol buffer based RPC Sub-task Resolved Devaraj Das
         
        2.
        Add PB-based calls to HMasterRegionInterface Sub-task Closed Gregory Chanan
         
        3.
        Add PB-based calls to HMasterInterface Sub-task Closed Gregory Chanan
         
        4.
        Replace serialization for client-facing ZK data with PBs Sub-task Closed stack
         
        5.
        Support for custom filters with PB-based RPC Sub-task Closed Gregory Chanan
         
        6.
        Support for dynamic coprocessor endpoints with PB-based RPC Sub-task Closed Gary Helmling
         
        7.
        Support for wire-compatible security functionality Sub-task Closed Matteo Bertozzi
         
        8.
        Support for wire-compatibility in inter-cluster replication (ZK, etc) Sub-task Resolved Chris Trezzo
         
        9.
        Switch RPC call envelope/headers to PBs Sub-task Closed Devaraj Das
         
        10.
        Fixes for HBase shell with protobuf-based data Sub-task Resolved Chris Trezzo
         
        11.
        Switch on-disk formats (reference files, HFile meta fields, etc) to PB Sub-task Closed stack
         
        12.
        Introduce Protocol Buffer RPC engine Sub-task Closed Devaraj Das
         
        13.
        Import .META. table exported from 0.94 Sub-task Resolved Unassigned
         
        14.
        Convert .META. and -ROOT- content to pb Sub-task Closed Enis Soztutar
         
        15.
        Remove the WritableRpcEngine & associated Invocation classes Sub-task Closed Devaraj Das
         
        16.
        The introspection, etc. of objects in the RPC has to be handled for PB objects Sub-task Closed stack
         
        17.
        Remove the SecureRPCEngine and merge the security-related logic in the core engine Sub-task Closed Devaraj Das
         
        18.
        General cleanup/optimizations of the protobuf RPC engine & associated RPC code Sub-task Resolved Devaraj Das
         
        19.
        Convert AggregateProtocol to protobuf defined coprocessor service Sub-task Closed Devaraj Das
         
        20.
        Convert MultiRowMutationProtocol to protocol buffer service Sub-task Closed Devaraj Das
         
        21.
        Convert RowProcessorProtocol to protocol buffer service Sub-task Closed Devaraj Das
         
        22.
        Convert AuthenticationProtocol to protocol buffer service Sub-task Closed Gary Helmling
         
        23. Define a common interface for the user code serialization/deserialization bits during coprocessor invocations Sub-task Open Unassigned
         
        24.
        Enforce PB ser/de for user code bits in the protocol implementations Sub-task Resolved Devaraj Das
         
        25.
        Convert test CoprocessorProtocol implementations to protocol buffer services Sub-task Closed stack
         
        26.
        Convert security-related shell commands to use PB-based AccessControlService Sub-task Closed Jimmy Xiang
         
        27.
        Convert HLog / HFile metadata content to PB Sub-task Closed Unassigned
         
        28.
        Remove references to Writable in the ipc package Sub-task Closed stack
         
        29.
        Enforce PB ser/de for Aggregate protocol and associated ColumnInterpreter user code bits Sub-task Closed Devaraj Das
         
        30.
        Convert WAL to pb Sub-task Closed Sergey Shelukhin
         
        31.
        Convert some HFile metadata to PB Sub-task Closed Andrew Purtell
         
        32.
        Protobuf WAL also needs a trailer Sub-task Closed Himanshu Vashishtha
         

          Activity

          Devaraj Das created issue -
          stack made changes -
          Field Original Value New Value
          Link This issue is part of HBASE-2182 [ HBASE-2182 ]
          Jimmy Xiang made changes -
          Link This issue relates to HBASE-5443 [ HBASE-5443 ]
          Jimmy Xiang made changes -
          Link This issue is related to HBASE-5443 [ HBASE-5443 ]
          stack made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          stack made changes -
          Attachment commons-io.txt [ 12528170 ]
          stack made changes -
          Attachment commons-io.txt [ 12528170 ]
          stack made changes -
          Comment [ Add commons-io to 'test' scope. See if that fixes the failures. ]
          Devaraj Das made changes -
          Link This issue incorporates HBASE-6282 [ HBASE-6282 ]
          Devaraj Das made changes -
          Link This issue requires HBASE-5732 [ HBASE-5732 ]
          Devaraj Das made changes -
          Link This issue requires HBASE-6414 [ HBASE-6414 ]
          stack made changes -
          Fix Version/s 0.96.0 [ 12320040 ]
          Gary Helmling made changes -
          Link This issue is related to HBASE-7215 [ HBASE-7215 ]
          Devaraj Das made changes -
          Priority Blocker [ 1 ] Major [ 3 ]
          stack made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          stack made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          stack made changes -
          Tags 0.96notable

            People

            • Assignee:
              Unassigned
              Reporter:
              Devaraj Das
            • Votes:
              0 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development