Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5031

BlockScanner scans the block multiple times and on restart scans everything

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.1.0-beta, 3.0.0-alpha1
    • 2.2.0
    • datanode
    • None

    Description

      BlockScanner scans the block twice, also on restart of datanode scans everything.

      Steps:
      1. Write blocks with interval of more than 5 seconds. write new block on completion of scan for written block.

      Each time datanode scans new block, it also scans, previous block which is already scanned.

      Now after restart, datanode scans all blocks again.

      Attachments

        1. HDFS-5031.patch
          8 kB
          Vinayakumar B
        2. HDFS-5031.patch
          8 kB
          Vinayakumar B
        3. HDFS-5031.patch
          8 kB
          Vinayakumar B

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinayakumarb Vinayakumar B
            vinayakumarb Vinayakumar B
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment