Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3922

0.22 and 0.23 namenode throws away blocks under construction on restart

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.22.1, 0.23.3
    • Fix Version/s: 0.23.4
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When reading edits on startup, namenode may throw away blocks under construction. This is because the file inode is turned into a "under construction" one, but nothing is done to the last block.

      With append/hsync, this is not acceptable because it may drop sync'ed partial blocks. In branch 2 and trunk, HDFS-1623 (HA) fixed this issue.

        Activity

        Daryn Sharp made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.23.4 [ 12320242 ]
        Resolution Fixed [ 1 ]
        Kihwal Lee made changes -
        Affects Version/s 0.23.3 [ 12320052 ]
        Affects Version/s 0.20.203.0 [ 12316150 ]
        Target Version/s 0.23.4 [ 12320242 ]
        Kihwal Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Kihwal Lee made changes -
        Attachment hdfs-3922.branch-023.patch.txt [ 12545035 ]
        Suresh Srinivas made changes -
        Field Original Value New Value
        Fix Version/s 0.22.1 [ 12319241 ]
        Fix Version/s 0.23.4 [ 12320242 ]
        Kihwal Lee created issue -

          People

          • Assignee:
            Kihwal Lee
            Reporter:
            Kihwal Lee
          • Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development