Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1377

Log aggregation via node manager should expose expose a way to cancel log aggregation at application or container level

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Today when application finishes it starts aggregating all the logs but that may slow down the whole process significantly...
      there can be situations where certain containers overwrote the logs .. say in multiple GBs....in these scenarios we need a way to cancel log aggregation for certain containers. These can be at per application level or at per container level.
      thoughts?

        Attachments

          Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue YARN-221 NM should provide a way for AM to tell it not to aggregate logs.

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                ojoshi Omkar Vinit Joshi
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: