Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5425

Renaming underconstruction file with snapshots can make NN failure on restart

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: namenode, snapshots
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      I faced this When i am doing some snapshot operations like createSnapshot,renameSnapshot,i restarted my NN,it is shutting down with exception,
      2013-10-24 21:07:03,040 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join
      java.lang.IllegalStateException
      at com.google.common.base.Preconditions.checkState(Preconditions.java:133)
      at org.apache.hadoop.hdfs.server.namenode.snapshot.INodeDirectoryWithSnapshot$ChildrenDiff.replace(INodeDirectoryWithSnapshot.java:82)
      at org.apache.hadoop.hdfs.server.namenode.snapshot.INodeDirectoryWithSnapshot$ChildrenDiff.access$700(INodeDirectoryWithSnapshot.java:62)
      at org.apache.hadoop.hdfs.server.namenode.snapshot.INodeDirectoryWithSnapshot$DirectoryDiffList.replaceChild(INodeDirectoryWithSnapshot.java:397)
      at org.apache.hadoop.hdfs.server.namenode.snapshot.INodeDirectoryWithSnapshot$DirectoryDiffList.access$900(INodeDirectoryWithSnapshot.java:376)
      at org.apache.hadoop.hdfs.server.namenode.snapshot.INodeDirectoryWithSnapshot.replaceChild(INodeDirectoryWithSnapshot.java:598)
      at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedReplaceINodeFile(FSDirectory.java:1548)
      at org.apache.hadoop.hdfs.server.namenode.FSDirectory.replaceINodeFile(FSDirectory.java:1537)
      at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$Loader.loadFilesUnderConstruction(FSImageFormat.java:855)
      at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$Loader.load(FSImageFormat.java:350)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:910)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:899)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:751)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:720)
      at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:266)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:784)
      at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:563)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:422)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:472)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:670)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:655)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1245)
      at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1311)
      2013-10-24 21:07:03,050 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1
      2013-10-24 21:07:03,052 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:

        Attachments

        1. HDFS-5425.patch
          3 kB
          Vinayakumar B
        2. HDFS-5425.patch
          3 kB
          Vinayakumar B
        3. HDFS-5425.patch
          3 kB
          Vinayakumar B
        4. HDFS-5425.001.patch
          8 kB
          Jing Zhao

          Activity

            People

            • Assignee:
              jingzhao Jing Zhao
              Reporter:
              sathish.gurram sathish
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
              '"-->>]]> ERROR OCCURRED