Pig
  1. Pig
  2. PIG-291

hod.param parameters not passed properly

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: impl
    • Labels:
      None
    • Environment:

      Description

      pig -Dhod.param='-N hodclustername' script.pig

      fails with the following error:

      2008-07-03 17:53:18,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
      org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:428)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:121)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:108)
      at org.apache.pig.impl.PigContext.connect(PigContext.java:177)
      at org.apache.pig.PigServer.<init>(PigServer.java:149)
      at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
      at org.apache.pig.Main.main(Main.java:293)
      Caused by: org.apache.pig.backend.executionengine.ExecException: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:541)
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:373)
      ... 6 more
      Caused by: org.apache.pig.backend.executionengine.ExecException: Failed to run command hod allocate -d /tmp/PigHod.hostname.thatha.304309240344558 -n 15 -N hodclustername on server local; return code: 4; error: CRITICAL - qsub Failure : qsub: illegal -N value
      at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:538)
      ... 7 more

      It appears that the problem is in the parsing of hod.param, located in org/apache/pig/backend/hadoop/executionengine/HExecutionEngine.java, in doHod(...).

        Activity

        Ian Atha created issue -
        Ian Atha made changes -
        Field Original Value New Value
        Attachment pig-291.diff [ 12385241 ]
        Ian Atha made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ian Atha made changes -
        Attachment pig-291.patch [ 12385243 ]
        Ian Atha made changes -
        Attachment pig-291.diff [ 12385241 ]
        Ian Atha made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Ian Atha made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Olga Natkovich made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Alan Gates made changes -
        Assignee Ian Atha [ thatha ]
        Alan Gates made changes -
        Fix Version/s 0.1.0 [ 12312848 ]
        Alan Gates made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Ian Atha
            Reporter:
            Ian Atha
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 2h
              2h
              Remaining:
              Remaining Estimate - 2h
              2h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development