Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-578

Failed tasks should not be put at the end of the job tracker's queue

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.6.2
    • 0.8.0
    • None
    • None

    Description

      This functionality was basically a workaround for other problems, which have been fixed. The impact of putting them at the end of the work queue is that if you have 100,000 maps, and the Mapper fails deterministically, you'll run 300,000+ attempts before your job is killed.

      Attachments

        1. Hadoop-578.patch
          3 kB
          Sanjay Dahiya

        Activity

          People

            sanjay.dahiya Sanjay Dahiya
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: