Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-578

Failed tasks should not be put at the end of the job tracker's queue

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.6.2
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      This functionality was basically a workaround for other problems, which have been fixed. The impact of putting them at the end of the work queue is that if you have 100,000 maps, and the Mapper fails deterministically, you'll run 300,000+ attempts before your job is killed.

        Attachments

        1. Hadoop-578.patch
          3 kB
          Sanjay Dahiya

          Activity

            People

            • Assignee:
              sanjay.dahiya Sanjay Dahiya
              Reporter:
              omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: