Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11240

Print hdfs pipeline when hlog's sync is slow

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.99.0
    • Operability, wal
    • None
    • Adds emission of a log message that lists datanodes in HDFS pipeline when sync is slow. Set when to log with "hbase.regionserver.hlog.slowsync.ms". Defaults logging if sync takes > 100ms.

    Description

      Sometimes the slow sync of hlog writer is because there is an abnormal datanode in the pipeline. So it will be helpful to print the pipeline of slow sync to diagnose those problems.

      The ultimate solution is to join the trace of HBase and HDFS.

      Attachments

        1. HBASE-11240-trunk-v1.diff
          4 kB
          Shaohui Liu
        2. HBASE-11240-trunk-v2.diff
          4 kB
          Shaohui Liu
        3. HBASE-11240-addendum.diff
          1 kB
          Shaohui Liu

        Issue Links

          relates to

          Task - A task that needs to be done. HBASE-13000 Backport HBASE-11240 (Print hdfs pipeline when hlog's sync is slow) to 0.98

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              liushaohui Shaohui Liu
              liushaohui Shaohui Liu
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: