Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3520

Generation stamp upgrade fails TestDFSUpgradeFromImage

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.18.0
    • 0.18.0
    • None
    • None
    • Reviewed

    Description

      TestDFSUpgradeFromImage occasionally fails doing distributed upgrade related to generation stamps with the following NPE:

      java.lang.NullPointerException
      	at org.apache.hadoop.dfs.UpgradeManagerDatanode.initializeUpgrade(UpgradeManagerDatanode.java:54)
      	at org.apache.hadoop.dfs.DataStorage.verifyDistributedUpgradeProgress(DataStorage.java:402)
      	at org.apache.hadoop.dfs.DataStorage.doTransition(DataStorage.java:232)
      	at org.apache.hadoop.dfs.DataStorage.recoverTransitionRead(DataStorage.java:139)
      	at org.apache.hadoop.dfs.DataNode.startDataNode(DataNode.java:268)
      	at org.apache.hadoop.dfs.DataNode.<init>(DataNode.java:185)
      	at org.apache.hadoop.dfs.DataNode.makeInstance(DataNode.java:2952)
      	at org.apache.hadoop.dfs.DataNode.instantiateDataNode(DataNode.java:2907)
      	at org.apache.hadoop.dfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:401)
      	at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:267)
      	at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:162)
      	at org.apache.hadoop.dfs.TestDFSUpgradeFromImage.testUpgradeFromImage(TestDFSUpgradeFromImage.java:180)
      

      Attachments

        1. failure.log
          29 kB
          Konstantin Shvachko
        2. upgradeNPE.patch
          0.6 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: