Details
-
Sub-task
-
Status: Open
-
Critical
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently, if log aggregation is enabled for a cluster - logs for all jobs will be aggregated - leading to a whole bunch of files on hdfs which users may not want.
Users should be able to control this along with the aggregation policy - failed only, all, etc.
Attachments
Issue Links
- blocks
-
YARN-386 [Umbrella] YARN API Changes
- Open
- is related to
-
YARN-221 NM should provide a way for AM to tell it not to aggregate logs.
- Resolved
-
MAPREDUCE-3143 Complete aggregation of user-logs spit out by containers onto DFS
- Closed