[YARN-7014] container-executor has off-by-one error which can corrupt the heap

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 3.0.0-beta1
• Fix Version/s: 3.0.0-beta1
• Component/s: yarn
• Target Version/s: 3.0.0-beta1
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Shane Kumpf
• Due: 30/Sep/17
• Created: 15/Aug/17 13:58
• Updated: 16/Aug/17 17:49
• Resolved: 15/Aug/17 20:57

Description

test-container-executor is failing in trunk.

[INFO] 
[INFO] --- hadoop-maven-plugins:3.0.0-beta1-SNAPSHOT:cmake-test (test-container-executor) @ hadoop-yarn-server-nodemanager ---
[INFO] -------------------------------------------------------
[INFO]  C M A K E B U I L D E R    T E S T
[INFO] -------------------------------------------------------
[INFO] test-container-executor: running /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native/target/usr/local/bin/test-container-executor
[INFO] with extra environment variables {}
[INFO] STATUS: ERROR CODE 134 after 3714 millisecond(s).
[INFO] -------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 13:47 min
[INFO] Finished at: 2017-08-12T12:58:55+00:00
[INFO] Final Memory: 19M/296M
[INFO] ------------------------------------------------------------------------
[WARNING] The requested profile "parallel-tests" could not be activated because it does not exist.
[WARNING] The requested profile "yarn-ui" could not be activated because it does not exist.
[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:3.0.0-beta1-SNAPSHOT:cmake-test (test-container-executor) on project hadoop-yarn-server-nodemanager: Test /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/native/target/usr/local/bin/test-container-executor returned ERROR CODE 134 -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Issue Links

• is broken by: YARN-6726 Fix issues with docker commands executed by container-executor