[HDFS-4000] TestParallelLocalRead fails with "input ByteBuffers must be direct buffers"

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha
• Fix Version/s: 2.0.3-alpha
• Hadoop Flags: Reviewed
• Assignee: Colin McCabe
• Reporter: Eli Collins
• Created: 02/Oct/12 22:59
• Updated: 15/Feb/13 13:11
• Resolved: 04/Oct/12 02:43

Description

I think this may be related to HDFS-3753, passes when I revert it. Here's failure. Looks like it needs the same fix as TestShortCircuitLocalRead, not sure why that didn't show up in the jenkins run.

java.lang.AssertionError: Check log for errors
	at org.junit.Assert.fail(Assert.java:91)
	at org.apache.hadoop.hdfs.TestParallelReadUtil.runTestWorkload(TestParallelReadUtil.java:373)
	at org.apache.hadoop.hdfs.TestParallelLocalRead.testParallelReadByteBuffer(TestParallelLocalRead.java:61)

2012-10-02 15:39:49,481 ERROR hdfs.TestParallelReadUtil (TestParallelReadUtil.java:run(227)) - ReadWorker-1-/TestParallelRead.dat.0: Error while testing read at 199510 length 14773
java.lang.IllegalArgumentException: input ByteBuffers must be direct buffers
	at org.apache.hadoop.util.NativeCrc32.nativeVerifyChunkedSums(Native Method)
	at org.apache.hadoop.util.NativeCrc32.verifyChunkedSums(NativeCrc32.java:57)
	at org.apache.hadoop.util.DataChecksum.verifyChunkedSums(DataChecksum.java:291)
	at org.apache.hadoop.hdfs.BlockReaderLocal.doByteBufferRead(BlockReaderLocal.java:501)
	at org.apache.hadoop.hdfs.BlockReaderLocal.read(BlockReaderLocal.java:409)
	at org.apache.hadoop.hdfs.DFSInputStream$ByteBufferStrategy.doRead(DFSInputStream.java:561)
	at org.apache.hadoop.hdfs.DFSInputStream.readBuffer(DFSInputStream.java:594)
	at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:648)
	at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:696)
	at org.apache.hadoop.hdfs.TestParallelReadUtil$DirectReadWorkerHelper.read(TestParallelReadUtil.java:91)
	at org.apache.hadoop.hdfs.TestParallelReadUtil$DirectReadWorkerHelper.pRead(TestParallelReadUtil.java:104)
	at org.apache.hadoop.hdfs.TestParallelReadUtil$ReadWorker.pRead(TestParallelReadUtil.java:275)
	at org.apache.hadoop.hdfs.TestParallelReadUtil$ReadWorker.run(TestParallelReadUtil.java:223)

Issue Links

• is related to: HDFS-3753 Tests don't run with native libraries