Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6456

Support configurable log aggregation policy

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      YARN-221 provides a way for a YARN application to specify log aggregation policy via LogAggregationContext.

      This jira covers the necessary changes in MR to use that feature so that any MR job can specify its log aggregation policy via job configuration. That includes:

      • Have MR define its own configurations to config these policies.
      • Make code change at YarnRunner to retrieve these configurations and set the values via LogAggregationContext.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue YARN-221 NM should provide a way for AM to tell it not to aggregate logs.

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              mingma Ming Ma
              mingma Ming Ma
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: