Pig
  1. Pig
  2. PIG-291

hod.param parameters not passed properly

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: impl
    • Labels:
      None
    • Environment:

      Description

      pig -Dhod.param='-N hodclustername' script.pig

      fails with the following error:

      2008-07-03 17:53:18,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
      org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:428)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:121)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:108)
      at org.apache.pig.impl.PigContext.connect(PigContext.java:177)
      at org.apache.pig.PigServer.<init>(PigServer.java:149)
      at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
      at org.apache.pig.Main.main(Main.java:293)
      Caused by: org.apache.pig.backend.executionengine.ExecException: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:541)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:373)
      ... 6 more
      Caused by: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:538)
      ... 7 more

      It appears that the problem is in the parsing of hod.param, located in org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java, in doHod(...).

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Ian Atha
            Reporter:
            Ian Atha
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 2h
              2h
              Remaining:
              Remaining Estimate - 2h
              2h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development