Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Add a new DataTransferProtocol operation, Op.TRANSFER_BLOCK, for transferring RBW/Finalized with acknowledgement and without using RPC.

      Description

      TestTransferRbw failed in build #264

      org.apache.hadoop.hdfs.server.datanode.ReplicaNotFoundException: 65536 = numBytes < visible = 90564, r=ReplicaInPipeline, blk_8440021909252053811_1001, TEMPORARY
        getNumBytes()     = 65536
        getBytesOnDisk()  = 0
        getVisibleLength()= -1
        getVolume()       = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/current/finalized
        getBlockFile()    = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/tmp/blk_8440021909252053811
        bytesAcked=0
        bytesOnDisk=0
      	at org.apache.hadoop.hdfs.server.datanode.FSDataset.convertTemporaryToRbw(FSDataset.java:1383)
      	at org.apache.hadoop.hdfs.server.datanode.DataNode.convertTemporaryToRbw(DataNode.java:2023)
      	at org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.testTransferRbw(TestTransferRbw.java:121)
      
      1. h1761_20110329.patch
        34 kB
        Tsz Wo Nicholas Sze
      2. h1761_20110325.patch
        42 kB
        Tsz Wo Nicholas Sze
      3. h1761_20110319.patch
        8 kB
        Tsz Wo Nicholas Sze
      4. h1761_20110318.patch
        8 kB
        Tsz Wo Nicholas Sze
      5. h1761_20110317.patch
        3 kB
        Tsz Wo Nicholas Sze
      6. build264.log
        36 kB
        Tsz Wo Nicholas Sze

        Activity

        Tsz Wo Nicholas Sze created issue -
        Tsz Wo Nicholas Sze made changes -
        Field Original Value New Value
        Attachment build264.log [ 12473859 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h1761_20110317.patch [ 12473932 ]
        Tsz Wo Nicholas Sze made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.23.0 [ 12315571 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h1761_20110318.patch [ 12474058 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h1761_20110319.patch [ 12474084 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h1761_20110325.patch [ 12474686 ]
        Tsz Wo Nicholas Sze made changes -
        Attachment h1761_20110329.patch [ 12474936 ]
        Tsz Wo Nicholas Sze made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Incompatible change, Reviewed]
        Release Note Add a new DataTransferProtocol operation, Op.TRANSFER_BLOCK, for transferring RBW/Finalized with acknowledgement and without using RPC.
        Fix Version/s 0.23.0 [ 12315571 ]
        Resolution Fixed [ 1 ]
        Tsz Wo Nicholas Sze made changes -
        Summary TestTransferRbw fails Add a new DataTransferProtocol operation, Op.TRANSFER_BLOCK, instead of using RPC
        Description It failed in [build #264|https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/264/testReport/org.apache.hadoop.hdfs.server.datanode/TestTransferRbw/testTransferRbw/]
        {noformat}
        org.apache.hadoop.hdfs.server.datanode.ReplicaNotFoundException: 65536 = numBytes < visible = 90564, r=ReplicaInPipeline, blk_8440021909252053811_1001, TEMPORARY
          getNumBytes() = 65536
          getBytesOnDisk() = 0
          getVisibleLength()= -1
          getVolume() = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/current/finalized
          getBlockFile() = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/tmp/blk_8440021909252053811
          bytesAcked=0
          bytesOnDisk=0
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.convertTemporaryToRbw(FSDataset.java:1383)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.convertTemporaryToRbw(DataNode.java:2023)
        at org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.testTransferRbw(TestTransferRbw.java:121)
        {noformat}
        TestTransferRbw failed in [build #264|https://hudson.apache.org/hudson/job/PreCommit-HDFS-Build/264/testReport/org.apache.hadoop.hdfs.server.datanode/TestTransferRbw/testTransferRbw/]
        {noformat}
        org.apache.hadoop.hdfs.server.datanode.ReplicaNotFoundException: 65536 = numBytes < visible = 90564, r=ReplicaInPipeline, blk_8440021909252053811_1001, TEMPORARY
          getNumBytes() = 65536
          getBytesOnDisk() = 0
          getVisibleLength()= -1
          getVolume() = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/current/finalized
          getBlockFile() = /grid/0/hudson/hudson-slave/workspace/PreCommit-HDFS-Build/trunk/build/test/data/dfs/data/data3/tmp/blk_8440021909252053811
          bytesAcked=0
          bytesOnDisk=0
        at org.apache.hadoop.hdfs.server.datanode.FSDataset.convertTemporaryToRbw(FSDataset.java:1383)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.convertTemporaryToRbw(DataNode.java:2023)
        at org.apache.hadoop.hdfs.server.datanode.TestTransferRbw.testTransferRbw(TestTransferRbw.java:121)
        {noformat}
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Tsz Wo Nicholas Sze
            Reporter:
            Tsz Wo Nicholas Sze
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development