Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-85

Allow per job log aggregation configuration

          Details

          • Type: Sub-task
          • Status: Open
          • Priority: Critical
          • Resolution: Unresolved
          • Affects Version/s: None
          • Fix Version/s: None
          • Component/s: nodemanager
          • Labels:
            None

            Description

            Currently, if log aggregation is enabled for a cluster - logs for all jobs will be aggregated - leading to a whole bunch of files on hdfs which users may not want.
            Users should be able to control this along with the aggregation policy - failed only, all, etc.

              Attachments

                Issue Links

                blocks

                Bug - A problem which impairs or prevents the functions of the product. YARN-386 [Umbrella] YARN API Changes

                • Major - Major loss of function.
                • Open
                is related to

                Sub-task - The sub-task of the issue YARN-221 NM should provide a way for AM to tell it not to aggregate logs.

                • Major - Major loss of function.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-3143 Complete aggregation of user-logs spit out by containers onto DFS

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      sseth Siddharth Seth
                    • Votes:
                      1 Vote for this issue
                      Watchers:
                      9 Start watching this issue

                      Dates

                      • Created:
                        Updated: