[HADOOP-8887] Use a Maven plugin to build the native code using CMake

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: build
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed
• Assignee: Colin McCabe
• Reporter: Colin McCabe
• Created: 05/Oct/12 18:37
• Updated: 30/Aug/16 01:33
• Resolved: 14/Jan/16 19:18

Description

Currently, we build the native code using ant-build invocations. Although this works, it has some limitations:

• compiler warning messages are hidden, which can cause people to check in code with warnings unintentionally
• there is no framework for running native unit tests; instead, we use ad-hoc constructs involving shell scripts
• the antrun code is very platform specific
• there is no way to run a specific native unit test
• it's more or less impossible for scripts like test-patch.sh to separate a native test failing from the build itself failing (no files are created) or to enumerate which native tests failed.

Using a native Maven plugin would overcome these limitations.

Issue Links

• breaks: HADOOP-12714 Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the "glibc bug spill" file.
• is related to: YARN-4594 container-executor fails to remove directory tree when chmod required
• is related to: HADOOP-12712 Fix some cmake plugin and native build warnings