[HDFS-3753] Tests don't run with native libraries

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.0.3-alpha
• Component/s: build, test
• Hadoop Flags: Reviewed
• Assignee: Colin McCabe
• Reporter: Eli Collins
• Created: 02/Aug/12 17:19
• Updated: 15/Feb/13 13:12
• Resolved: 02/Oct/12 21:15

Description

Test execution when run with the native flag and native libraries have been built don't actually use the native libs because NativeCodeLoader is unable to load native-hadoop. Eg run mvn compile -Pnative then mvn -Dtest=TestSeekBug test -Pnative and check the test output. This is because the test's java.library.path is looking for the lib in hdfs (
hadoop-hdfs-project/hadoop-hdfs/target/native/target/usr/local/lib) however the native lib lives in common. I confirmed copying the lib to the appropriate directory fixes things. We need to update the java.library.path for test execution to include the common lib dir. This may be an issue with MR as well.

Issue Links

• relates to: HDFS-4003 test-patch should build the common native libs before running hdfs tests
• relates to: HADOOP-8648 libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1
• relates to: HDFS-3754 BlockSender doesn't shutdown ReadaheadPool threads
• relates to: HDFS-4000 TestParallelLocalRead fails with "input ByteBuffers must be direct buffers"