Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4517

Too many INFO messages written out during AM to RM heartbeat

    Details

    • Tags:
      applicationmaster

      Description

      Too many INFO log messages written out during AM to RM heartbeat. Based on default frequency of 1000ms (scheduler.heartbeat.interval-ms) either 2 or 4 INFO messages are written out per second:

      LOG.info("Before Scheduling: " + getStat());
      List<Container> allocatedContainers = getResources();
      LOG.info("After Scheduling: " + getStat());
      if (allocatedContainers.size() > 0)

      { LOG.info("Before Assign: " + getStat()); scheduledRequests.assign(allocatedContainers); LOG.info("After Assign: " + getStat()); }

      These should probably be changed to DEBUG message to save the log growing too quickly.

      1. MAPREDUCE-4517.patch
        7 kB
        Jason Lowe
      2. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      3. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      4. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      5. MAPREDUCE-4517.patch
        1 kB
        James Kinley

        Activity

          People

          • Assignee:
            Jason Lowe
            Reporter:
            James Kinley
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development