Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-291

hod.param parameters not passed properly

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: impl
    • Labels:
      None
    • Environment:

      Description

      pig -Dhod.param='-N hodclustername' script.pig

      fails with the following error:

      2008-07-03 17:53:18,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
      org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:428)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:121)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:108)
      at org.apache.pig.impl.PigContext.connect(PigContext.java:177)
      at org.apache.pig.PigServer.<init>(PigServer.java:149)
      at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
      at org.apache.pig.Main.main(Main.java:293)
      Caused by: org.apache.pig.backend.executionengine.ExecException: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:541)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:373)
      ... 6 more
      Caused by: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:538)
      ... 7 more

      It appears that the problem is in the parsing of hod.param, located in org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java, in doHod(...).

        Attachments

          Activity

            People

            • Assignee:
              thatha Ian Atha
              Reporter:
              thatha Ian Atha
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 2h
                2h
                Remaining:
                Remaining Estimate - 2h
                2h
                Logged:
                Time Spent - Not Specified
                Not Specified