Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1377

Log aggregation via node manager should expose expose a way to cancel log aggregation at application or container level

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Today when application finishes it starts aggregating all the logs but that may slow down the whole process significantly...
      there can be situations where certain containers overwrote the logs .. say in multiple GBs....in these scenarios we need a way to cancel log aggregation for certain containers. These can be at per application level or at per container level.
      thoughts?

        Attachments

        Issue Links

        is duplicated by

        Sub-task - The sub-task of the issue YARN-221 NM should provide a way for AM to tell it not to aggregate logs.

        • Major - Major loss of function.
        • Resolved

          Activity
          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              xgong Xuan Gong
              Reporter:
              ojoshi Omkar Vinit Joshi

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment