Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1982

Null pointer exception is thrown when NN restarts with a block lesser in size than the block that is present in DN1 but the generation stamp is greater in the NN

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20-append
    • Fix Version/s: 0.20-append
    • Component/s: namenode
    • Labels:
      None
    • Environment:

      Linux

      Description

      Conisder the following scenario.
      WE have a cluster with one NN and 2 DN.

      We write some file.

      One of the block is written in DN1 but not yet completed in DN2 local disk.

      Now DN1 gets killed and so pipeline recovery happens for the block with the size as in DN2 but the generation stamp gets updated in the NN.

      DN2 also gets killed.

      Now restart NN and DN1
      Now if NN restarts, the block that NN has greater time stamp but the size is lesser in the NN.

      This leads to Null pointer exception in addstoredblock api

        Activity

        ramkrishna.s.vasudevan created issue -
        ramkrishna.s.vasudevan made changes -
        Field Original Value New Value
        Hadoop Flags [Reviewed]

          People

          • Assignee:
            Unassigned
            Reporter:
            ramkrishna.s.vasudevan
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:

              Development