Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11240

Print hdfs pipeline when hlog's sync is slow

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: Operability, wal
    • Labels:
      None
    • Release Note:
      Adds emission of a log message that lists datanodes in HDFS pipeline when sync is slow. Set when to log with "hbase.regionserver.hlog.slowsync.ms". Defaults logging if sync takes > 100ms.

      Description

      Sometimes the slow sync of hlog writer is because there is an abnormal datanode in the pipeline. So it will be helpful to print the pipeline of slow sync to diagnose those problems.

      The ultimate solution is to join the trace of HBase and HDFS.

        Attachments

        1. HBASE-11240-addendum.diff
          1 kB
          Shaohui Liu
        2. HBASE-11240-trunk-v2.diff
          4 kB
          Shaohui Liu
        3. HBASE-11240-trunk-v1.diff
          4 kB
          Shaohui Liu

          Issue Links

            Activity

              People

              • Assignee:
                liushaohui Shaohui Liu
                Reporter:
                liushaohui Shaohui Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: