Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-140

When a file is deleted, its blocks remain in the blocksmap till the next block report from Datanode

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.20.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When a file is deleted, the namenode sends out block deletions messages to the appropriate datanodes. However, the namenode does not delete these blocks from the blocksmap. Instead, the processing of the next block report from the datanode causes these blocks to get removed from the blocksmap.

      If we desire to make block report processing less frequent, this issue needs to be addressed. Also, this introduces indeterministic behaviout to a a few unit tests. Another factor to consider is to ensure that duplicate block detection is not compromised.

        Issue Links

          Activity

          dhruba borthakur created issue -
          dhruba borthakur made changes -
          Field Original Value New Value
          Link This issue is related to HADOOP-4540 [ HADOOP-4540 ]
          Owen O'Malley made changes -
          Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
          Key HADOOP-1705 HDFS-140
          Component/s dfs [ 12310710 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is duplicated by HDFS-1230 [ HDFS-1230 ]
          Uma Maheswara Rao G made changes -
          Affects Version/s 0.20.1 [ 12314048 ]
          Uma Maheswara Rao G made changes -
          Assignee Uma Maheswara Rao G [ umamaheswararao ]
          Uma Maheswara Rao G made changes -
          Attachment HDFS-140.20security205.patch [ 12496782 ]
          Uma Maheswara Rao G made changes -
          Fix Version/s 0.20.205.0 [ 12316392 ]
          Matt Foley made changes -
          Fix Version/s 0.20.205.0 [ 12316392 ]
          Target Version/s 0.20.206.0 [ 12317959 ]
          Uma Maheswara Rao G made changes -
          Link This issue is duplicated by HDFS-1924 [ HDFS-1924 ]
          Uma Maheswara Rao G made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Won't Fix [ 2 ]
          Matt Foley made changes -
          Target Version/s 1.1.0 [ 12317959 ]

            People

            • Assignee:
              Uma Maheswara Rao G
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development