Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1018

Document changes to the memory management and scheduling model

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • documentation
    • None
    • Reviewed
    • Updated documentation related to (1) the changes in the configuration for memory management of tasks and (2) the modifications in scheduling model of CapacityTaskScheduler to include memory requirement by tasks.

    Description

      There were changes done for the configuration, monitoring and scheduling of high ram jobs. This must be documented in the mapred-defaults.xml and also on forrest documentation

      Attachments

        1. MAPRED-1018-1.patch
          13 kB
          rahul k singh
        2. MAPRED-1018-2.patch
          15 kB
          rahul k singh
        3. MAPRED-1018-3.patch
          20 kB
          rahul k singh
        4. MAPRED-1018-4.patch.txt
          22 kB
          rahul k singh
        5. MAPRED-1018-5.patch.txt
          22 kB
          Hemanth Yamijala
        6. MAPRED-1018-6.patch.txt
          22 kB
          Hemanth Yamijala
        7. MAPRED-1018-7.patch.txt
          31 kB
          Hemanth Yamijala
        8. MAPRED-1018-8.patch.txt
          34 kB
          Hemanth Yamijala
        9. MAPRED-1018-9.patch.txt
          17 kB
          Hemanth Yamijala
        10. MAPRED-1018-commons.patch
          8 kB
          rahul k singh

        Issue Links

        is related to

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-40 Memory management variables need a backwards compatibility option after HADOOP-5881

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-5881 Simplify configuration related to task-memory-monitoring and memory-based scheduling

        • Major - Major loss of function.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-6821 Document changes to memory monitoring

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            yhemanth Hemanth Yamijala Assign to me
            yhemanth Hemanth Yamijala
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment