Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-27888

Record readBlock message in log when it takes too long time

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.5.3
    • 2.6.0, 2.5.6, 3.0.0-beta-1
    • HFile
    • None
    • Reviewed
    • Hide
      Add a configuration parameter,which control to record read block slow in logs.
      <property>
        <name>hbase.fs.reader.warn.time.ms</name>
        <value>-1</value>
      </property>
      If reading block cost time in milliseconds more than the threshold, a warning will be logged,the default value is -1, it means skipping record the read block slow warning log.
      Show
      Add a configuration parameter,which control to record read block slow in logs. <property>   <name>hbase.fs.reader.warn.time.ms</name>   <value>-1</value> </property> If reading block cost time in milliseconds more than the threshold, a warning will be logged,the default value is -1, it means skipping record the read block slow warning log.

    Description

      After HBASE-15160, we can record the readBlock message by TRACE log in org.apache.hadoop.hbase.io.hfile.HFileBlock.FSReaderImpl#readBlockDataInternal, But it record all read block message in TRACE log, some times, we only focus the block read cost too much time..

      Attachments

        Issue Links

          Activity

            zhangduo Duo Zhang added a comment -

            Pushed to branch-2.5+.

            The code on branch-2.4 is a bit different so I did not port it to branch-2.4.

            Please fill the release note as we added a new config here. chaijunjie

            Thanks.

            zhangduo Duo Zhang added a comment - Pushed to branch-2.5+. The code on branch-2.4 is a bit different so I did not port it to branch-2.4. Please fill the release note as we added a new config here. chaijunjie Thanks.
            hudson Hudson added a comment -

            Results for branch branch-2
            build #833 on builds.a.o: -1 overall


            details (if available):

            +1 general checks
            – For more information see general report

            +1 jdk8 hadoop2 checks
            – For more information see jdk8 (hadoop2) report

            -1 jdk8 hadoop3 checks
            – For more information see jdk8 (hadoop3) report

            +1 jdk11 hadoop3 checks
            – For more information see jdk11 report

            +1 source release artifact
            – See build output for details.

            +1 client integration test

            hudson Hudson added a comment - Results for branch branch-2 build #833 on builds.a.o : -1 overall details (if available): +1 general checks – For more information see general report +1 jdk8 hadoop2 checks – For more information see jdk8 (hadoop2) report -1 jdk8 hadoop3 checks – For more information see jdk8 (hadoop3) report +1 jdk11 hadoop3 checks – For more information see jdk11 report +1 source release artifact – See build output for details. +1 client integration test
            hudson Hudson added a comment -

            Results for branch branch-3
            build #5 on builds.a.o: -1 overall


            details (if available):

            +1 general checks
            – For more information see general report

            -1 jdk8 hadoop3 checks
            – Something went wrong running this stage, please check relevant console output.

            +1 jdk11 hadoop3 checks
            – For more information see jdk11 report

            +1 source release artifact
            – See build output for details.

            +1 client integration test

            hudson Hudson added a comment - Results for branch branch-3 build #5 on builds.a.o : -1 overall details (if available): +1 general checks – For more information see general report -1 jdk8 hadoop3 checks – Something went wrong running this stage, please check relevant console output . +1 jdk11 hadoop3 checks – For more information see jdk11 report +1 source release artifact – See build output for details. +1 client integration test
            hudson Hudson added a comment -

            Results for branch master
            build #859 on builds.a.o: -1 overall


            details (if available):

            +1 general checks
            – For more information see general report

            +1 jdk8 hadoop3 checks
            – For more information see jdk8 (hadoop3) report

            -1 jdk11 hadoop3 checks
            – Something went wrong running this stage, please check relevant console output.

            +1 source release artifact
            – See build output for details.

            +1 client integration test

            hudson Hudson added a comment - Results for branch master build #859 on builds.a.o : -1 overall details (if available): +1 general checks – For more information see general report +1 jdk8 hadoop3 checks – For more information see jdk8 (hadoop3) report -1 jdk11 hadoop3 checks – Something went wrong running this stage, please check relevant console output . +1 source release artifact – See build output for details. +1 client integration test
            hudson Hudson added a comment -

            Results for branch branch-2.5
            build #369 on builds.a.o: -1 overall


            details (if available):

            +1 general checks
            – For more information see general report

            +1 jdk8 hadoop2 checks
            – For more information see jdk8 (hadoop2) report

            -1 jdk8 hadoop3 checks
            – For more information see jdk8 (hadoop3) report

            +1 jdk11 hadoop3 checks
            – For more information see jdk11 report

            +1 source release artifact
            – See build output for details.

            +1 client integration test

            hudson Hudson added a comment - Results for branch branch-2.5 build #369 on builds.a.o : -1 overall details (if available): +1 general checks – For more information see general report +1 jdk8 hadoop2 checks – For more information see jdk8 (hadoop2) report -1 jdk8 hadoop3 checks – For more information see jdk8 (hadoop3) report +1 jdk11 hadoop3 checks – For more information see jdk11 report +1 source release artifact – See build output for details. +1 client integration test
            chaijunjie chaijunjie added a comment -

            zhangduo Thanks for reviewing, I filled the  release note.

            chaijunjie chaijunjie added a comment - zhangduo Thanks for reviewing, I filled the  release note.

            People

              chaijunjie chaijunjie
              chaijunjie chaijunjie
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: