[PIG-5105] Tez unit tests failing with "Argument list too long"

• Type: Test
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.17.0
• Hadoop Flags: Reviewed
• Assignee: Rohini Palaniswamy
• Reporter: Koji Noguchi
• Created: 13/Jan/17 20:17
• Updated: 21/Jun/17 09:15
• Resolved: 13/Jan/17 22:56

Description

5 Tests failed with the same error.

• org.apache.pig.test.TestNativeMapReduce.testNativeMRJobTypeCastInserter
• org.apache.pig.test.TestNativeMapReduce.testNativeMRJobSimple
• org.apache.pig.test.TestNativeMapReduce.testNativeMRJobMultiStoreOnPred
• org.apache.pig.test.TestNativeMapReduce.testNativeMRJobMultiQueryOpt
• org.apache.pig.test.TestPredeployedJar.testPredeployedJar

2017-01-12 01:06:12,996 [ContainersLauncher #0] WARN  org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor  - Exception from container-launch with container ID: container_1484183112208_0002_01_000002 and exit code: 126
ExitCodeException exitCode=126: ./launch_container.sh: line 30: /bin/ln: Argument list too long

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
	at org.apache.hadoop.util.Shell.run(Shell.java:479)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

Issue Links

• is related to: PIG-5156 Duplicate jars in CLASSPATH when running test
• relates to: PIG-4837 TestNativeMapReduce test fix