Pig
  1. Pig
  2. PIG-232

Number of input/output rows in the logs is invalid with BinaryStorage

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: None
    • Labels:
      None

      Description

      My pig script:

      define CMD `perl PigStreamingBad.pl end` ship('PigStreamingBad.pl') stderr('CMD' limit 1);
      A = load 'studenttab10k';
      B = stream A through CMD;
      store B into 'out';

      My perl script:

      use strict;

      1. This script is used to test streaming error cases in pig.
      2. Usage: PigStreaming.pl <start|middle|end>
      3. the parameter tells the application when to exit with error

      if ($#ARGV < 0)
      {
      print STDERR "Usage PigStreaming.pl <start|middle|end>\n";
      exit (-1);
      }

      my $pos = $ARGV[0];

      if ($pos eq "start")
      {
      print STDERR "Failed in the beginning of the processing\n";
      exit(1);
      }

      print STDERR "PigStreamingBad.pl: starting processing\n";

      my $cnt = 0;
      while (<STDIN>)
      {
      print "$_";
      $cnt++;
      print STDERR "PigStreaming.pl: processing $_\n";
      if (($cnt > 100) && ($pos eq "middle"))

      { print STDERR "Failed in the middle of processing\n"; exit(2); }

      }

      print STDERR "Failed at the end of processing\n";
      exit(3);

      1. PIG-232_2_20080508.patch
        7 kB
        Arun C Murthy
      2. PIG-232_1_20080507.patch
        0.9 kB
        Arun C Murthy
      3. PIG-232_0_20080507.patch
        0.9 kB
        Arun C Murthy

        Activity

        Olga Natkovich created issue -
        Olga Natkovich made changes -
        Field Original Value New Value
        Summary Number of outpit rows in the log seems to be invalid when streaming application fails Number of output rows in the log seems to be invalid
        Arun C Murthy made changes -
        Attachment PIG-232_0_20080507.patch [ 12381630 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Arun C Murthy made changes -
        Attachment PIG-232_0_20080507.patch [ 12381630 ]
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Arun C Murthy made changes -
        Attachment PIG-232_0_20080507.patch [ 12381644 ]
        Arun C Murthy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Olga Natkovich made changes -
        Summary Number of output rows in the log seems to be invalid Number of input/output rows in the logs is invalid with BinaryStorage
        Arun C Murthy made changes -
        Attachment PIG-232_1_20080507.patch [ 12381649 ]
        Olga Natkovich made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Olga Natkovich made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Arun C Murthy made changes -
        Attachment PIG-232_2_20080508.patch [ 12381729 ]
        Arun C Murthy made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Olga Natkovich made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Olga Natkovich made changes -
        Fix Version/s 0.1.0 [ 12312848 ]
        Alan Gates made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Olga Natkovich
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development