Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11143

Improve replication metrics

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0, 0.94.20, 0.98.3
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We are trying to report on replication lag and find that there is no good single metric to do that.
      ageOfLastShippedOp is close, but unfortunately it is increased even when there is nothing to ship on a particular RegionServer.

      I would like discuss a few options here:
      Add a new metric: replicationQueueTime (or something) with the above meaning. I.e. if we have something to ship we set the age of that last shipped edit, if we fail we increment that last time (just like we do now). But if there is nothing to replicate we set it to current time (and hence that metric is reported to close to 0).
      Alternatively we could change the meaning of ageOfLastShippedOp to mean to do that. That might lead to surprises, but the current behavior is clearly weird when there is nothing to replicate.

      Comments? Jean-Daniel Cryans, Michael Stack.

      If approach sounds good, I'll make a patch for all branches.

      Edit: Also adds a new shippedKBs metric to track the amount of data that is shipped via replication.

        Attachments

        1. 11143-0.94.txt
          0.9 kB
          Lars Hofhansl
        2. 11143-0.94-v2.txt
          3 kB
          Lars Hofhansl
        3. 11143-0.94-v3.txt
          3 kB
          Lars Hofhansl
        4. 11143-trunk.txt
          3 kB
          Lars Hofhansl

          Issue Links

            Activity

              People

              • Assignee:
                larsh Lars Hofhansl
                Reporter:
                larsh Lars Hofhansl
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: