Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-85

Allow per job log aggregation configuration

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: nodemanager
    • Labels:
      None

      Description

      Currently, if log aggregation is enabled for a cluster - logs for all jobs will be aggregated - leading to a whole bunch of files on hdfs which users may not want.
      Users should be able to control this along with the aggregation policy - failed only, all, etc.

        Attachments

          Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. YARN-386 [Umbrella] YARN API Changes

          • Major - Major loss of function.
          • Open
          is related to

          Sub-task - The sub-task of the issue YARN-221 NM should provide a way for AM to tell it not to aggregate logs.

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-3143 Complete aggregation of user-logs spit out by containers onto DFS

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                sseth Siddharth Seth
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: