Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1499

JobTracker.finalizeJob inverts lock order and causes potential deadlock

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Cannot Reproduce
    • 0.20.1, 0.20.2
    • None
    • jobtracker
    • None

    Description

      This issue was brought up by Matei in MAPREDUCE-1436 as a fairsched bug, but it turns out it's a JT bug even with the fifo scheduler in unpatched 0.20.2. JobTracker.finalizeJob locks JT.jobs, JT.taskScheduler, etc, having gotten the JIP log before the JT lock.

      Attachments

        1. jcarder_result_1.dot.png
          23 kB
          Todd Lipcon
        2. jcarder_result_8.dot.png
          31 kB
          Todd Lipcon
        3. MAPREDUCE-1499.patch
          2 kB
          Aaron Kimball

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1436 Deadlock in preemption code in fair scheduler

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              kimballa Aaron Kimball
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: