Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6617

ReplicationSourceManager should be able to track multiple WAL paths

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0, 1.3.0, 2.0.0
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      ReplicationSourceManager now could track multiple wal paths. Notice that although most changes are internal and all metrics names remain the same, signature of below methods in MetricsSource are changed:

      1. refreshAgeOfLastShippedOp now requires a String parameter which indicates the wal group id of the reporter
      2. setAgeOfLastShippedOp also adds a String parameter for wal group id
      Show
      ReplicationSourceManager now could track multiple wal paths. Notice that although most changes are internal and all metrics names remain the same, signature of below methods in MetricsSource are changed: 1. refreshAgeOfLastShippedOp now requires a String parameter which indicates the wal group id of the reporter 2. setAgeOfLastShippedOp also adds a String parameter for wal group id

      Description

      Currently ReplicationSourceManager uses logRolled() to receive notification about new HLog and remembers it in latestPath.
      When region server has multiple WAL support, we need to keep track of multiple Path's in ReplicationSourceManager

        Attachments

        1. 6617-v11.patch
          96 kB
          Ted Yu
        2. HBASE-6617_v10.patch
          97 kB
          Yu Li
        3. HBASE-6617_v11.patch
          96 kB
          Yu Li
        4. HBASE-6617_v12.patch
          96 kB
          Yu Li
        5. HBASE-6617_v2.patch
          47 kB
          Yu Li
        6. HBASE-6617_v3.patch
          32 kB
          Yu Li
        7. HBASE-6617_v4.patch
          46 kB
          Yu Li
        8. HBASE-6617_v7.patch
          87 kB
          Yu Li
        9. HBASE-6617_v9.patch
          86 kB
          Yu Li
        10. HBASE-6617.branch-1.patch
          96 kB
          Yu Li
        11. HBASE-6617.branch-1.v2.patch
          96 kB
          Ted Yu
        12. HBASE-6617.branch-1.v2.patch
          96 kB
          Ted Yu
        13. HBASE-6617.branch-1.v2.patch
          96 kB
          Yu Li
        14. HBASE-6617.patch
          47 kB
          Yu Li

          Issue Links

            Activity

              People

              • Assignee:
                carp84 Yu Li
                Reporter:
                zhihyu@ebaysf.com Ted Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: