HBase
  1. HBase
  2. HBASE-10398

HBase book updates for Replication after HBASE-10322

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.98.0
    • Fix Version/s: 2.0.0
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    1. HBASE-10398.patch
      2 kB
      Misty Stanley-Jones
    2. HBASE-10398-1.patch
      3 kB
      Misty Stanley-Jones
    3. HBASE-10398-2.patch
      3 kB
      Misty Stanley-Jones

      Issue Links

        Activity

        Hide
        Misty Stanley-Jones added a comment -

        Anoop Sam John Do you mind providing some source material for these docs? I tried parsing HBASE-10322 but I need some help understanding it enough to document.

        Show
        Misty Stanley-Jones added a comment - Anoop Sam John Do you mind providing some source material for these docs? I tried parsing HBASE-10322 but I need some help understanding it enough to document.
        Hide
        Anoop Sam John added a comment -

        The normal codec which is used btw client and server will strip the tags. By default the replication will also use the same codec to pass Cells from server to server. So when tags are part of the Cells (ie. When one uses cell level visibility labels or cell level acl or any other feature which uses cell tags) we need to configure a Codec which supports shipping of tags also, along with Cells.
        We have introduced a config for this
        hbase.replication.rpc.codec
        Configure this with a Tag supported codec.
        org.apache.hadoop.hbase.codec.KeyValueCodecWithTags
        Also make sure this is configured in RS side in source and sink clusters of the Replication.

        Does this explain things well Misty?

        Show
        Anoop Sam John added a comment - The normal codec which is used btw client and server will strip the tags. By default the replication will also use the same codec to pass Cells from server to server. So when tags are part of the Cells (ie. When one uses cell level visibility labels or cell level acl or any other feature which uses cell tags) we need to configure a Codec which supports shipping of tags also, along with Cells. We have introduced a config for this hbase.replication.rpc.codec Configure this with a Tag supported codec. org.apache.hadoop.hbase.codec.KeyValueCodecWithTags Also make sure this is configured in RS side in source and sink clusters of the Replication. Does this explain things well Misty?
        Hide
        Misty Stanley-Jones added a comment -

        I think so yes. Right now we do not talk about replication in the Ref Guide at all – it is instead on the website: http://hbase.apache.org/replication.html

        Also, HBASE-11400 talks about codecs but it is codecs in terms of data block encoding, and this is a different thing which is clearly only about replication. So what I will do for now is add a note to the now-empty section of the Ref Guide: http://hbase.apache.org/book.html#cluster_replication and also a note where we talk about visibility tags: http://hbase.apache.org/book.html#hbase.visibility.labels

        As a separate task, I will move all the replication information into the Ref Guide and make sure this is then mentioned there. Sound right?

        Show
        Misty Stanley-Jones added a comment - I think so yes. Right now we do not talk about replication in the Ref Guide at all – it is instead on the website: http://hbase.apache.org/replication.html Also, HBASE-11400 talks about codecs but it is codecs in terms of data block encoding, and this is a different thing which is clearly only about replication. So what I will do for now is add a note to the now-empty section of the Ref Guide: http://hbase.apache.org/book.html#cluster_replication and also a note where we talk about visibility tags: http://hbase.apache.org/book.html#hbase.visibility.labels As a separate task, I will move all the replication information into the Ref Guide and make sure this is then mentioned there. Sound right?
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12655978/HBASE-10398.patch
        against trunk revision .
        ATTACHMENT ID: 12655978

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10080//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12655978/HBASE-10398.patch against trunk revision . ATTACHMENT ID: 12655978 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10080//console This message is automatically generated.
        Hide
        Misty Stanley-Jones added a comment -

        Sorry, I forgot to add the note to the Visibility Labels section too. Done now.

        Show
        Misty Stanley-Jones added a comment - Sorry, I forgot to add the note to the Visibility Labels section too. Done now.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12655981/HBASE-10398-1.patch
        against trunk revision .
        ATTACHMENT ID: 12655981

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10082//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12655981/HBASE-10398-1.patch against trunk revision . ATTACHMENT ID: 12655981 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10082//console This message is automatically generated.
        Hide
        Anoop Sam John added a comment -

        Sounds good Misty. Thanks..

        By default, the replication used between client and server strips tags

        Say By default, the replication between clusters strips tags

        Else looks good.

        Show
        Anoop Sam John added a comment - Sounds good Misty. Thanks.. By default, the replication used between client and server strips tags Say By default, the replication between clusters strips tags Else looks good.
        Hide
        Misty Stanley-Jones added a comment -

        Fixed.

        Show
        Misty Stanley-Jones added a comment - Fixed.
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12655985/HBASE-10398-2.patch
        against trunk revision .
        ATTACHMENT ID: 12655985

        +1 @author. The patch does not contain any @author tags.

        +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10083//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12655985/HBASE-10398-2.patch against trunk revision . ATTACHMENT ID: 12655985 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/10083//console This message is automatically generated.
        Hide
        Anoop Sam John added a comment -

        Great! +1
        Will commit later today.

        Show
        Anoop Sam John added a comment - Great! +1 Will commit later today.
        Hide
        Anoop Sam John added a comment -

        Thanks for the patch Misty.

        Show
        Anoop Sam John added a comment - Thanks for the patch Misty.
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-TRUNK #5313 (See https://builds.apache.org/job/HBase-TRUNK/5313/)
        HBASE-10398 HBase book updates for Replication after HBASE-10322. (Misty) (anoopsamjohn: rev da8f0a336d9a3b516fc1f5d33c462b1ef4996117)

        • src/main/docbkx/book.xml
        • src/main/docbkx/security.xml
        • src/main/docbkx/ops_mgt.xml
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-TRUNK #5313 (See https://builds.apache.org/job/HBase-TRUNK/5313/ ) HBASE-10398 HBase book updates for Replication after HBASE-10322 . (Misty) (anoopsamjohn: rev da8f0a336d9a3b516fc1f5d33c462b1ef4996117) src/main/docbkx/book.xml src/main/docbkx/security.xml src/main/docbkx/ops_mgt.xml

          People

          • Assignee:
            Misty Stanley-Jones
            Reporter:
            Anoop Sam John
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development