Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3596

[replication] Wait a few seconds before transferring queues

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.90.1
    • Fix Version/s: 0.90.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      ReplicationSourceManager.transferQueues is running a little too fast at the moment and this has the bad side effect of making us run into HBASE-2611 at almost every cluster restart. The reason is that some servers might shut down faster than others so that the last RS that are notified will at the same time see their friends dying, and will try to pick their queues. What happens then is that they also get told to shutdown and might be able to close their ZK session before the queue transfer process is completed, which is what 2611 is about.

      Currently the only to fix to that is to delete the lock znode by hand and bounce a region server so that it picks up the queue on startup.

      1. HBASE-3596.patch
        2 kB
        Jean-Daniel Cryans

        Activity

        Hide
        jdcryans Jean-Daniel Cryans added a comment -

        Simple patch that adds a configurable time to sleep before trying to lock a region server.

        Show
        jdcryans Jean-Daniel Cryans added a comment - Simple patch that adds a configurable time to sleep before trying to lock a region server.
        Hide
        stack stack added a comment -

        +1 Seems fine though waiting is probably not always going to work.

        Show
        stack stack added a comment - +1 Seems fine though waiting is probably not always going to work.
        Hide
        jdcryans Jean-Daniel Cryans added a comment -

        I agree, I will add a comment about that.

        Show
        jdcryans Jean-Daniel Cryans added a comment - I agree, I will add a comment about that.
        Hide
        jdcryans Jean-Daniel Cryans added a comment -

        Committed to branch and trunk, thanks for taking a look Stack.

        Show
        jdcryans Jean-Daniel Cryans added a comment - Committed to branch and trunk, thanks for taking a look Stack.
        Hide
        hudson Hudson added a comment -

        Integrated in HBase-TRUNK #1792 (See https://hudson.apache.org/hudson/job/HBase-TRUNK/1792/)

        Show
        hudson Hudson added a comment - Integrated in HBase-TRUNK #1792 (See https://hudson.apache.org/hudson/job/HBase-TRUNK/1792/ )
        Hide
        lars_francke Lars Francke added a comment -

        This issue was closed as part of a bulk closing operation on 2015-11-20. All issues that have been resolved and where all fixVersions have been released have been closed (following discussions on the mailing list).

        Show
        lars_francke Lars Francke added a comment - This issue was closed as part of a bulk closing operation on 2015-11-20. All issues that have been resolved and where all fixVersions have been released have been closed (following discussions on the mailing list).

          People

          • Assignee:
            jdcryans Jean-Daniel Cryans
            Reporter:
            jdcryans Jean-Daniel Cryans
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development