[PIG-291] hod.param parameters not passed properly

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.1.0
• Component/s: impl

Environment

Linux hostname 2.6.9-55.ELsmp #1 SMP Fri Apr 20 16:36:54 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux
Apache Pig version 0.1.0-dev (r8087)
Hadoop 0.17.1 Subversion http://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.17 -r 669344
hod --version: 0.17.1

• Assignee: Ian Atha
• Reporter: Ian Atha
• Created: 03/Jul/08 17:53
• Updated: 25/Mar/10 00:12
• Resolved: 08/Jul/08 23:15

Description

pig -Dhod.param='-N hodclustername' script.pig

fails with the following error:

2008-07-03 17:53:18,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:428)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:121)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:108)
at org.apache.pig.impl.PigContext.connect(PigContext.java:177)
at org.apache.pig.PigServer.<init>(PigServer.java:149)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
at org.apache.pig.Main.main(Main.java:293)
Caused by: org.apache.pig.backend.executionengine.ExecException: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:541)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:373)
... 6 more
Caused by: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:538)
... 7 more

It appears that the problem is in the parsing of hod.param, located in org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java, in doHod(...).