Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5881

Simplify configuration related to task-memory-monitoring and memory-based scheduling

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.20.1
    • None
    • None
    • Incompatible change, Reviewed

    Description

      The configuration we have now is pretty complicated. Besides everything else, the mechanism of not specifying parameters separately for maps and reduces leads to problems like HADOOP-5811. This JIRA should address simplifying things and at the same time solving these problems.

      Attachments

        1. HADOOP-5881-20090526-branch-20.1.txt
          122 kB
          Vinod Kumar Vavilapalli
        2. HADOOP-5881-20090526.1.txt
          123 kB
          Vinod Kumar Vavilapalli

        Issue Links

        blocks

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-5883 TaskMemoryMonitorThread might shoot down tasks even if their processes momentarily exceed the requested memory

        • Major - Major loss of function.
        • Resolved
        incorporates

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-140 TaskMemoryManager not enforcing memory limits in the presence of rogue tasks

        • Major - Major loss of function.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1018 Document changes to the memory management and scheduling model

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-516 Fix the 'cluster drain' problem in the Capacity Scheduler wrt High RAM Jobs

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinodkv Vinod Kumar Vavilapalli
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment