Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-5535 (Rolling upgrades)
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Link to Jenkins precommit run for HDFS-5535.

      Failure exception:

      org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-1810550394-67.195.138.22-1392967331823:blk_1073741825_1001 file=/TestDataNodeRollingUpgrade1.dat
      	at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:883)
      	at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:558)
      	at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:791)
      	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:838)
      	at java.io.DataInputStream.read(DataInputStream.java:83)
      	at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:80)
      	at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:54)
      	at org.apache.hadoop.hdfs.DFSTestUtil.readFileBuffer(DFSTestUtil.java:203)
      	at org.apache.hadoop.hdfs.DFSTestUtil.readFile(DFSTestUtil.java:193)
      	at org.apache.hadoop.hdfs.server.datanode.TestDataNodeRollingUpgrade.testDatanodeRollingUpgradeWithRollback(TestDataNodeRollingUpgrade.java:166)
      

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1h 6m 1 Tsz Wo Nicholas Sze 21/Feb/14 22:40
        Tsz Wo Nicholas Sze made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Fix Version/s HDFS-5535 (Rolling upgrades) [ 12325754 ]
        Resolution Fixed [ 1 ]
        Hide
        Tsz Wo Nicholas Sze added a comment -

        I have committed this. Thanks, Arpit!

        Show
        Tsz Wo Nicholas Sze added a comment - I have committed this. Thanks, Arpit!
        Tsz Wo Nicholas Sze made changes -
        Hadoop Flags Reviewed [ 10343 ]
        Hide
        Tsz Wo Nicholas Sze added a comment -

        +1 the patch works well.

        Show
        Tsz Wo Nicholas Sze added a comment - +1 the patch works well.
        Arpit Agarwal made changes -
        Field Original Value New Value
        Attachment HDFS-5994.01.patch [ 12630398 ]
        Hide
        Arpit Agarwal added a comment -
        1. For findbugs fix we throw an exception if mkdirs() returns false but the error is benign if the directory already exists.
        2. Another fix to restoreBlockFilesFromTrash to short-circuit for child directories.
        3. Update test to create multi-block files to test checking the exists() case.
        Show
        Arpit Agarwal added a comment - For findbugs fix we throw an exception if mkdirs() returns false but the error is benign if the directory already exists. Another fix to restoreBlockFilesFromTrash to short-circuit for child directories. Update test to create multi-block files to test checking the exists() case.
        Arpit Agarwal created issue -

          People

          • Assignee:
            Arpit Agarwal
            Reporter:
            Arpit Agarwal
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development