Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-220

NM should limit number of applications who's logs are being aggregated

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.23.4
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      The NodeManager should limit the number of applications that have their logs being aggregated in parallel. This will reduce the load on the NN. We need to ensure that the RM will continue to renew the token while this is happening. We also should look if the NM starts to fall behind if it can delete some of the logs or not.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              revans2 Robert Joseph Evans
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: