Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1981

When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failing

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: namenode
    • Labels:
      None
    • Environment:

      Linux

    • Hadoop Flags:
      Reviewed

      Description

      This scenario is applicable in NN and BNN case.

      When the namenode goes down after creating the edits.new, on subsequent restart the divertFileStreams will not happen to edits.new as the edits.new file is already present and the size is zero.

      so on trying to saveCheckPoint an exception occurs
      2011-05-23 16:38:57,476 WARN org.mortbay.log: /getimage: java.io.IOException: GetImage failed. java.io.IOException: Namenode has an edit log with timestamp of 2011-05-23 16:38:56 but new checkpoint was created using editlog with timestamp 2011-05-23 16:37:30. Checkpoint Aborted.

      This is a bug or is that the behaviour.

      1. HDFS-1981-2.patch
        4 kB
        ramkrishna.s.vasudevan
      2. HDFS-1981-1.patch
        5 kB
        ramkrishna.s.vasudevan
      3. HDFS-1981.patch
        5 kB
        ramkrishna.s.vasudevan
      4. HDFS-1981_0.23.patch
        4 kB
        Uma Maheswara Rao G
      5. HDFS-1981_0.22.patch
        4 kB
        Uma Maheswara Rao G

        Issue Links

          Activity

          ramkrishna.s.vasudevan created issue -
          ramkrishna.s.vasudevan made changes -
          Field Original Value New Value
          Hadoop Flags [Reviewed]
          ramkrishna.s.vasudevan made changes -
          Attachment HDFS-1981.patch [ 12482669 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Fix Version/s 0.22.0 [ 12314241 ]
          Fix Version/s 0.23.0 [ 12315571 ]
          Affects Version/s 0.22.0 [ 12314241 ]
          Affects Version/s 0.23.0 [ 12315571 ]
          Priority Major [ 3 ] Blocker [ 1 ]
          Todd Lipcon made changes -
          Link This issue relates to HADOOP-5314 [ HADOOP-5314 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HDFS-1981-1.patch [ 12484445 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HDFS-1981-2.patch [ 12485748 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Uma Maheswara Rao G made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Uma Maheswara Rao G made changes -
          Attachment HDFS-1981_0.23.patch [ 12487871 ]
          Uma Maheswara Rao G made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee Uma Maheswara Rao G [ umamaheswararao ]
          Uma Maheswara Rao G made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Uma Maheswara Rao G made changes -
          Attachment HDFS-1981_0.22.patch [ 12487967 ]
          Uma Maheswara Rao G made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Uma Maheswara Rao G
              Reporter:
              ramkrishna.s.vasudevan
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development