Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4000

TestParallelLocalRead fails with "input ByteBuffers must be direct buffers"

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha
    • Fix Version/s: 2.0.3-alpha
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I think this may be related to HDFS-3753, passes when I revert it. Here's failure. Looks like it needs the same fix as TestShortCircuitLocalRead, not sure why that didn't show up in the jenkins run.

      java.lang.AssertionError: Check log for errors
      	at org.junit.Assert.fail(Assert.java:91)
      	at org.apache.hadoop.hdfs.TestParallelReadUtil.runTestWorkload(TestParallelReadUtil.java:373)
      	at org.apache.hadoop.hdfs.TestParallelLocalRead.testParallelReadByteBuffer(TestParallelLocalRead.java:61)
      
      2012-10-02 15:39:49,481 ERROR hdfs.TestParallelReadUtil (TestParallelReadUtil.java:run(227)) - ReadWorker-1-/TestParallelRead.dat.0: Error while testing read at 199510 length 14773
      java.lang.IllegalArgumentException: input ByteBuffers must be direct buffers
      	at org.apache.hadoop.util.NativeCrc32.nativeVerifyChunkedSums(Native Method)
      	at org.apache.hadoop.util.NativeCrc32.verifyChunkedSums(NativeCrc32.java:57)
      	at org.apache.hadoop.util.DataChecksum.verifyChunkedSums(DataChecksum.java:291)
      	at org.apache.hadoop.hdfs.BlockReaderLocal.doByteBufferRead(BlockReaderLocal.java:501)
      	at org.apache.hadoop.hdfs.BlockReaderLocal.read(BlockReaderLocal.java:409)
      	at org.apache.hadoop.hdfs.DFSInputStream$ByteBufferStrategy.doRead(DFSInputStream.java:561)
      	at org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:594)
      	at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:648)
      	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:696)
      	at org.apache.hadoop.hdfs.TestParallelReadUtil$DirectReadWorkerHelper.read(TestParallelReadUtil.java:91)
      	at org.apache.hadoop.hdfs.TestParallelReadUtil$DirectReadWorkerHelper.pRead(TestParallelReadUtil.java:104)
      	at org.apache.hadoop.hdfs.TestParallelReadUtil$ReadWorker.pRead(TestParallelReadUtil.java:275)
      	at org.apache.hadoop.hdfs.TestParallelReadUtil$ReadWorker.run(TestParallelReadUtil.java:223)
      

        Attachments

        1. HDFS-4000.001.patch
          1.0 kB
          Colin McCabe

          Issue Links

            Activity

              People

              • Assignee:
                cmccabe Colin McCabe
                Reporter:
                eli Eli Collins
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: