Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2827

Cannot save namespace after renaming a directory above a file with an open lease

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.1, 1.2.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When i execute the following operations and wait for checkpoint to complete.

      fs.mkdirs(new Path("/test1"));
      FSDataOutputStream create = fs.create(new Path("/test/abc.txt")); //dont close
      fs.rename(new Path("/test/"), new Path("/test1/"));

      Check-pointing is failing with the following exception.

      2012-01-23 15:03:14,204 ERROR namenode.FSImage (FSImage.java:run(795)) - Unable to save image for E:\HDFS-1623\hadoop-hdfs-project\hadoop-hdfs\build\test\data\dfs\name3
      java.io.IOException: saveLeases found path /test1/est/abc.txt but no matching entry in namespace.[/test1/est/abc.txt]
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4336)
      at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$Saver.save(FSImageFormat.java:588)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.saveFSImage(FSImage.java:761)
      at org.apache.hadoop.hdfs.server.namenode.FSImage$FSImageSaver.run(FSImage.java:789)
      at java.lang.Thread.run(Unknown Source)

      1. HDFS-2827-test.patch
        2 kB
        Aaron T. Myers
      2. HDFS-2827.patch
        4 kB
        Uma Maheswara Rao G
      3. hdfs-2827-b1.txt
        4 kB
        Eli Collins

        Activity

        Allen Wittenauer made changes -
        Fix Version/s 0.24.0 [ 12317653 ]
        Allen Wittenauer made changes -
        Affects Version/s 0.24.0 [ 12317653 ]
        Eli Collins made changes -
        Fix Version/s 1.2.0 [ 12321657 ]
        Target Version/s 0.24.0 [ 12317653 ]
        Eli Collins made changes -
        Attachment hdfs-2827-b1.txt [ 12535600 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Uma Maheswara Rao G made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Uma Maheswara Rao G made changes -
        Resolution Incomplete [ 4 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Tsz Wo Nicholas Sze made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.24.0 [ 12317653 ]
        Fix Version/s 0.23.1 [ 12318885 ]
        Resolution Incomplete [ 4 ]
        Tsz Wo Nicholas Sze made changes -
        Hadoop Flags Reviewed [ 10343 ]
        Uma Maheswara Rao G made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Uma Maheswara Rao G made changes -
        Attachment HDFS-2827.patch [ 12511688 ]
        Aaron T. Myers made changes -
        Summary Checkpointing is failing with saveleases found but no entry in namespace. Cannot save namespace after renaming a directory above a file with an open lease
        Aaron T. Myers made changes -
        Affects Version/s 0.24.0 [ 12317653 ]
        Affects Version/s HA branch (HDFS-1623) [ 12317568 ]
        Target Version/s 0.24.0 [ 12317653 ]
        Environment Dev env - Windows
        Component/s name-node [ 12312926 ]
        Component/s ha [ 12316609 ]
        Aaron T. Myers made changes -
        Attachment HDFS-2827-test.patch [ 12511638 ]
        Aaron T. Myers made changes -
        Parent HDFS-1623 [ 12498318 ]
        Issue Type Sub-task [ 7 ] Bug [ 1 ]
        Uma Maheswara Rao G made changes -
        Parent HDFS-1623 [ 12498318 ]
        Issue Type Bug [ 1 ] Sub-task [ 7 ]
        Uma Maheswara Rao G made changes -
        Field Original Value New Value
        Summary Next checkpointing is failing with saveleases found but no entry in namespace. Checkpointing is failing with saveleases found but no entry in namespace.
        Uma Maheswara Rao G created issue -

          People

          • Assignee:
            Uma Maheswara Rao G
            Reporter:
            Uma Maheswara Rao G
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development