Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-5535 (Rolling upgrades)
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Link to Jenkins precommit run for HDFS-5535.

      Failure exception:

      org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1810550394-67.195.138.22-1392967331823:blk_1073741825_1001 file=/TestDataNodeRollingUpgrade1.dat
      	at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:883)
      	at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:558)
      	at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:791)
      	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:838)
      	at java.io.DataInputStream.read(DataInputStream.java:83)
      	at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:80)
      	at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:54)
      	at org.apache.hadoop.hdfs.DFSTestUtil.readFileBuffer(DFSTestUtil.java:203)
      	at org.apache.hadoop.hdfs.DFSTestUtil.readFile(DFSTestUtil.java:193)
      	at org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade.testDatanodeRollingUpgradeWithRollback(TestDataNodeRollingUpgrade.java:166)
      

        Activity

        Hide
        Tsz Wo Nicholas Sze added a comment -

        I have committed this. Thanks, Arpit!

        Show
        Tsz Wo Nicholas Sze added a comment - I have committed this. Thanks, Arpit!
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 the patch works well.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 the patch works well.
        Hide
        Arpit Agarwal added a comment -
        1. For findbugs fix we throw an exception if mkdirs() returns false but the error is benign if the directory already exists.
        2. Another fix to restoreBlockFilesFromTrash to short-circuit for child directories.
        3. Update test to create multi-block files to test checking the exists() case.
        Show
        Arpit Agarwal added a comment - For findbugs fix we throw an exception if mkdirs() returns false but the error is benign if the directory already exists. Another fix to restoreBlockFilesFromTrash to short-circuit for child directories. Update test to create multi-block files to test checking the exists() case.

          People

          • Assignee:
            Arpit Agarwal
            Reporter:
            Arpit Agarwal
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development