Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5194

Heed interrupts during Fetcher shutdown

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • task
    • None
    • Reviewed

    Description

      In the current implementation, Fetcher instances usually exit gracefully when the shuffle succeeds. When it fails, threads are interrupted, but may continue running harmlessly until the JVM shuts down.

      However, to generate consistent checkpoints, these threads should exit cleanly to quiesce the state of the shuffle.

      Attachments

        1. M5194-2.patch
          30 kB
          Christopher Douglas
        2. M5194-1.patch
          25 kB
          Christopher Douglas
        3. M5194.patch
          28 kB
          Christopher Douglas

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-5456 TestFetcher.testCopyFromHostExtraBytes is missing

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is part of

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-4584 Umbrella: Preemption and restart of MapReduce tasks

          • Major - Major loss of function.
          • Open

          Activity

            People

              cdouglas Christopher Douglas
              cdouglas Christopher Douglas
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: