Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-336

The logging level of the tasks should be configurable by the job

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Hide
      Allow logging level of map/reduce tasks to be configurable.
      Configuration changes:
        add mapred.map.child.log.level
        add mapred.reduce.child.log.level
      Show
      Allow logging level of map/reduce tasks to be configurable. Configuration changes:   add mapred.map.child.log.level   add mapred.reduce.child.log.level

      Description

      It would be nice to be able to configure the logging level of the Task JVM's separately from the server JVM's. Reducing logging substantially increases performance and reduces the consumption of local disk on the task trackers.

        Issue Links

          Activity

          Owen O'Malley created issue -
          Owen O'Malley made changes -
          Field Original Value New Value
          Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
          Key HADOOP-5786 MAPREDUCE-336
          Component/s mapred [ 12310690 ]
          Arun C Murthy made changes -
          Assignee Arun C Murthy [ acmurthy ]
          Arun C Murthy made changes -
          Attachment MAPREDUCE-336_0_20090818.patch [ 12416955 ]
          Arun C Murthy made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.21.0 [ 12314045 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note Allow logging level of map/reduce tasks to be configurable.
          Configuration changes:
            add mapred.map.child.log.level
            add mapred.reduce.child.log.level
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Arun C Murthy made changes -
          Link This issue is a clone of MAPREDUCE-5408 [ MAPREDUCE-5408 ]

            People

            • Assignee:
              Arun C Murthy
              Reporter:
              Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development