Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7423

The check for maxtaskfailures.per.tracker is missing

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.4
    • None
    • tasktracker
    • None

    Description

      In the conf file mapred-default.xml, the description of mapreduce.job.maxtaskfailures.per.tracker is:

      The number of task-failures on a node manager of a given job after which new tasks of that job aren't assigned to it. It MUST be less than mapreduce.map.maxattempts and mapreduce.reduce.maxattempts otherwise the failed task will never be tried on a different node.

      However, there is no checking implement in source code. Violations of the dependency will prevent failed tasks from trying on different nodes. So, it is suggested to check the dependency of the two configuration parameters before using maxtaskfailures.per.tracker.

      Attachments

        Activity

          People

            Unassigned Unassigned
            wangteng13 teng wang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: