Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8143

HDFS Mover tool should exit after some retry when failed to move blocks.

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Pending Closed
    • 2.6.0
    • 2.7.1
    • balancer & mover
    • None
    • Reviewed

    Description

      Mover is not coming out in case of failed to move blocks.

      hasRemaining |= Dispatcher.waitForMoveCompletion(storages.targets.values());

      Dispatcher.waitForMoveCompletion() will always return true if some blocks migration failed. So hasRemaining never become false.

      Attachments

        1. HDFS-8143.patch
          4 kB
          Surendra Singh Lilhore
        2. HDFS-8143_3.patch
          9 kB
          Surendra Singh Lilhore
        3. HDFS-8143_2.patch
          9 kB
          Surendra Singh Lilhore
        4. HDFS-8143_1.patch
          7 kB
          Surendra Singh Lilhore

        Issue Links

        is required by

        Sub-task - The sub-task of the issue HDFS-8541 Mover should exit with NO_MOVE_PROGRESS if there is no move progress

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-8147 Mover should not schedule two replicas to the same DN storage

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            surendralilhore Surendra Singh Lilhore Assign to me
            surendralilhore Surendra Singh Lilhore
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment