Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13092

Reduce verbosity for ThrottledAsyncChecker.java:schedule

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.1.0, 3.0.1
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      ThrottledAsyncChecker.java:schedule prints a log message every time a disk check is scheduled. However if the previous check was triggered lesser than the frequency at "minMsBetweenChecks" then the task is not scheduled. This jira will reduce the log verbosity by printing the message only when the task will be scheduled.

      2018-01-29 00:51:44,467 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,470 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,477 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/4/hadoop/hdfs/data/current
      2018-01-29 00:51:44,480 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/4/hadoop/hdfs/data/current
      2018-01-29 00:51:44,486 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/11/hadoop/hdfs/data/current
      2018-01-29 00:51:44,501 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/13/hadoop/hdfs/data/current
      2018-01-29 00:51:44,507 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/11/hadoop/hdfs/data/current
      2018-01-29 00:51:44,533 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,536 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,543 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/10/hadoop/hdfs/data/current
      2018-01-29 00:51:44,544 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,548 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/3/hadoop/hdfs/data/current
      2018-01-29 00:51:44,549 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/5/hadoop/hdfs/data/current
      2018-01-29 00:51:44,550 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/6/hadoop/hdfs/data/current
      2018-01-29 00:51:44,551 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,552 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/10/hadoop/hdfs/data/current
      2018-01-29 00:51:44,552 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/8/hadoop/hdfs/data/current
      2018-01-29 00:51:44,552 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,554 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/9/hadoop/hdfs/data/current
      2018-01-29 00:51:44,555 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/8/hadoop/hdfs/data/current
      2018-01-29 00:51:44,555 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/14/hadoop/hdfs/data/current
      2018-01-29 00:51:44,560 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,560 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,564 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/5/hadoop/hdfs/data/current
      2018-01-29 00:51:44,564 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,570 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/5/hadoop/hdfs/data/current
      2018-01-29 00:51:44,576 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/8/hadoop/hdfs/data/current
      2018-01-29 00:51:44,586 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/2/hadoop/hdfs/data/current
      2018-01-29 00:51:44,591 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/12/hadoop/hdfs/data/current
      2018-01-29 00:51:44,600 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/6/hadoop/hdfs/data/current
      2018-01-29 00:51:44,628 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/9/hadoop/hdfs/data/current
      2018-01-29 00:51:44,653 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/5/hadoop/hdfs/data/current
      2018-01-29 00:51:44,653 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/3/hadoop/hdfs/data/current
      2018-01-29 00:51:44,668 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/9/hadoop/hdfs/data/current
      2018-01-29 00:51:44,687 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/6/hadoop/hdfs/data/current
      2018-01-29 00:51:44,694 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/5/hadoop/hdfs/data/current
      2018-01-29 00:51:44,707 INFO  checker.ThrottledAsyncChecker (ThrottledAsyncChecker.java:schedule(107)) - Scheduling a check for /grid/6/hadoop/hdfs/data/current
      

        Attachments

        1. HDFS-13092.001.patch
          1 kB
          Mukul Kumar Singh

          Activity

            People

            • Assignee:
              msingh Mukul Kumar Singh
              Reporter:
              msingh Mukul Kumar Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: