Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8646

Prune cached replicas from DatanodeDescriptor state on replica invalidation

VotersStop watchingWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.8.0, 3.0.0-alpha1
    • caching
    • None

    Description

      Currently we remove blocks from the DD's CachedBlockLists on node failure and on cache report, but not on replica invalidation. This can lead to an invalid situation where we return a LocatedBlock with cached locations that are not backed by an on-disk replica.

      Attachments

        1. hdfs-8646.001.patch
          13 kB
          Andrew Wang
        2. hdfs-8646.002.patch
          14 kB
          Andrew Wang

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            andrew.wang Andrew Wang
            andrew.wang Andrew Wang
            Votes:
            0 Vote for this issue
            Watchers:
            5 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment