Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4517

Too many INFO messages written out during AM to RM heartbeat

    Details

      Description

      Too many INFO log messages written out during AM to RM heartbeat. Based on default frequency of 1000ms (scheduler.heartbeat.interval-ms) either 2 or 4 INFO messages are written out per second:

      LOG.info("Before Scheduling: " + getStat());
      List<Container> allocatedContainers = getResources();
      LOG.info("After Scheduling: " + getStat());
      if (allocatedContainers.size() > 0) {
      LOG.info("Before Assign: " + getStat());
      scheduledRequests.assign(allocatedContainers);
      LOG.info("After Assign: " + getStat());
      }

      These should probably be changed to DEBUG message to save the log growing too quickly.

        Attachments

        1. MAPREDUCE-4517.patch
          7 kB
          Jason Lowe
        2. MAPREDUCE-4517.patch
          6 kB
          Jason Lowe
        3. MAPREDUCE-4517.patch
          6 kB
          Jason Lowe
        4. MAPREDUCE-4517.patch
          6 kB
          Jason Lowe
        5. MAPREDUCE-4517.patch
          1 kB
          James Kinley

          Activity

            People

            • Assignee:
              jlowe Jason Lowe
              Reporter:
              jrkinley James Kinley
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: