Pig
  1. Pig
  2. PIG-174

Pig hangs at progress 0% in this case

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Pig appears to hang at progress 0% with the following console output:

      2008-03-28 13:58:50,398 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: wilbur11.labs.corp.sp1.yahoo.com:8020
      2008-03-28 13:58:51,342 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - ----- MapReduce Job -----
      2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Input: [/user/pig/tests/data/singlefile/studenttab10k:org.apache.pig.builtin.PigStorage()]
      2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Map: [[*]->org.apache.pig.impl.eval.StreamSpec@16fa474]
      2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Group: null
      2008-03-28 13:58:51,343 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Combine: null
      2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Reduce: null
      2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Output: results_7:org.apache.pig.builtin.PigStorage
      2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Split: null
      2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Map parallelism: -1
      2008-03-28 13:58:51,344 [main] INFO  org.apache.pig.backend.hadoop.executionengine.POMapreduce - Reduce parallelism: -1
      2008-03-28 13:58:54,245 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapreduceExec.MapReduceLauncher - Pig progress = 0%
      

      The contents of the pig script used is as follows:

      define X `./streamingscript/MySimpleStreamApp.pl` ship('./streamingscript/MySimpleStreamApp.pl');
      A = load '/user/pig/tests/data/singlefile/studenttab10k';
      B = stream A through X;
      store B into 'results_7';
      

      The streaming script "MySimpleStreamApp.pl" is as follows and it is located under the streamingscript directory in my home directory. I issued the pig command from my home directory.

      #!/home/y/bin/perl
      
      while (<>) {
          chomp;
          print "$_\n";
      }
      

        Activity

        Alan Gates made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Olga Natkovich made changes -
        Fix Version/s 0.1.0 [ 12312848 ]
        Olga Natkovich made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Arun C Murthy made changes -
        Attachment PIG-174_0_20080402.patch [ 12379218 ]
        Xu Zhang made changes -
        Priority Major [ 3 ] Minor [ 4 ]
        Xu Zhang made changes -
        Status Resolved [ 5 ] Reopened [ 4 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Field Original Value New Value
        Resolution Fixed [ 1 ]
        Status Open [ 1 ] Resolved [ 5 ]
        Xu Zhang created issue -

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Xu Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development