Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4517

Too many INFO messages written out during AM to RM heartbeat

    Details

      Description

      Too many INFO log messages written out during AM to RM heartbeat. Based on default frequency of 1000ms (scheduler.heartbeat.interval-ms) either 2 or 4 INFO messages are written out per second:

      LOG.info("Before Scheduling: " + getStat());
      List<Container> allocatedContainers = getResources();
      LOG.info("After Scheduling: " + getStat());
      if (allocatedContainers.size() > 0)

      { LOG.info("Before Assign: " + getStat()); scheduledRequests.assign(allocatedContainers); LOG.info("After Assign: " + getStat()); }

      These should probably be changed to DEBUG message to save the log growing too quickly.

      1. MAPREDUCE-4517.patch
        1 kB
        James Kinley
      2. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      3. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      4. MAPREDUCE-4517.patch
        6 kB
        Jason Lowe
      5. MAPREDUCE-4517.patch
        7 kB
        Jason Lowe

        Activity

        Allen Wittenauer made changes -
        Fix Version/s 3.0.0 [ 12320355 ]
        Thomas Graves made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 3.0.0 [ 12320355 ]
        Fix Version/s 2.0.3-alpha [ 12323275 ]
        Fix Version/s 0.23.5 [ 12323312 ]
        Resolution Fixed [ 1 ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4517.patch [ 12553363 ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4517.patch [ 12553278 ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4517.patch [ 12553271 ]
        Jason Lowe made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 2.0.1-alpha [ 12322466 ]
        Affects Version/s 0.23.1 [ 12318883 ]
        Target Version/s 2.0.3-alpha, 0.23.5 [ 12323275, 12323312 ]
        Assignee Jason Lowe [ jlowe ]
        Fix Version/s trunk [ 12320360 ]
        Jason Lowe made changes -
        Attachment MAPREDUCE-4517.patch [ 12553265 ]
        Jason Lowe made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        James Kinley made changes -
        Attachment MAPREDUCE-4517.patch [ 12544442 ]
        James Kinley made changes -
        Attachment MAPREDUCE-4517.patch [ 12539306 ]
        James Kinley made changes -
        Attachment MAPREDUCE-4517.patch [ 12539306 ]
        James Kinley made changes -
        Field Original Value New Value
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 2.0.0-alpha [ 12320354 ]
        Labels patch
        Fix Version/s trunk [ 12320360 ]
        Tags applicationmaster
        James Kinley created issue -

          People

          • Assignee:
            Jason Lowe
            Reporter:
            James Kinley
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development