Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-386

Periodically move blocks from full nodes to those with space

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.4.0
    • 0.5.0
    • None
    • None

    Description

      I'm still having a lot of problems with some nodes filling up quickly and others hardly being touched, mostly because of the hardware being
      very different.

      As someone suggested, there should be a thread that periodically checks the dfs for nodes with little or no free space and schedules blocks
      to be moved off that node.

      Attachments

        1. excessRepSpaceAware.patch
          2 kB
          Johan Oskarsson

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            johanoskarsson Johan Oskarsson
            johanoskarsson Johan Oskarsson
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment