Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5584

ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Duplicate
    • 2.3.0
    • None
    • None
    • None

    Description

      While running gridmix on 2.3 we noticed that jobs are running much slower than normal. We tracked this down to reducers having difficulties shuffling data from maps. Details to follow.

      Attachments

        Issue Links

          is broken by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9652 Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10048 LocalDirAllocator should avoid holding locks while accessing the filesystem

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: