Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4208

NameNode could be stuck in SafeMode due to never-created blocks

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.1.2
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Target Version/s:

      Description

      In one test case, NameNode allocated a block and then was killed before the client got the addBlock response. After NameNode restarted, it couldn't get out of SafeMode waiting for the block which was never created. In trunk, NameNode can get out of SafeMode since it only counts complete blocks. However branch-1 doesn't have the clear notion of under-constructioned-block in Namenode.

      JIRA HDFS-4212 is to track the never-created-block issue and this JIRA is to fix NameNode in branch-1 so it can get out of SafeMode when never-created-block exists.

      The proposed idea is for SafeMode not to count the zero-sized last block in an under-construction file as part of total blcok count.

      1. HDFS-4208.branch-1.patch
        4 kB
        Brandon Li
      2. HDFS-4208.branch-1.patch
        5 kB
        Brandon Li
      3. HDFS-4208.branch-1.patch
        6 kB
        Brandon Li

        Issue Links

          Activity

            People

            • Assignee:
              Brandon Li
              Reporter:
              Brandon Li
            • Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development