Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8646

Prune cached replicas from DatanodeDescriptor state on replica invalidation

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: caching
    • Labels:
      None
    • Target Version/s:

      Description

      Currently we remove blocks from the DD's CachedBlockLists on node failure and on cache report, but not on replica invalidation. This can lead to an invalid situation where we return a LocatedBlock with cached locations that are not backed by an on-disk replica.

        Attachments

        1. hdfs-8646.001.patch
          13 kB
          Andrew Wang
        2. hdfs-8646.002.patch
          14 kB
          Andrew Wang

          Activity

            People

            • Assignee:
              andrew.wang Andrew Wang
              Reporter:
              andrew.wang Andrew Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: