Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5194

Heed interrupts during Fetcher shutdown

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.1.0-beta
    • task
    • None
    • Reviewed

    Description

      In the current implementation, Fetcher instances usually exit gracefully when the shuffle succeeds. When it fails, threads are interrupted, but may continue running harmlessly until the JVM shuts down.

      However, to generate consistent checkpoints, these threads should exit cleanly to quiesce the state of the shuffle.

      Attachments

        1. M5194.patch
          28 kB
          Christopher Douglas
        2. M5194-1.patch
          25 kB
          Christopher Douglas
        3. M5194-2.patch
          30 kB
          Christopher Douglas

        Issue Links

          Activity

            People

              cdouglas Christopher Douglas
              cdouglas Christopher Douglas
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: