Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-232

Number of input/output rows in the logs is invalid with BinaryStorage

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: None
    • Labels:
      None

      Description

      My pig script:

      define CMD `perl PigStreamingBad.pl end` ship('PigStreamingBad.pl') stderr('CMD' limit 1);
      A = load 'studenttab10k';
      B = stream A through CMD;
      store B into 'out';

      My perl script:

      use strict;

      1. This script is used to test streaming error cases in pig.
      2. Usage: PigStreaming.pl <start|middle|end>
      3. the parameter tells the application when to exit with error

      if ($#ARGV < 0)
      {
      print STDERR "Usage PigStreaming.pl <start|middle|end>\n";
      exit (-1);
      }

      my $pos = $ARGV[0];

      if ($pos eq "start")
      {
      print STDERR "Failed in the beginning of the processing\n";
      exit(1);
      }

      print STDERR "PigStreamingBad.pl: starting processing\n";

      my $cnt = 0;
      while (<STDIN>)
      {
      print "$_";
      $cnt++;
      print STDERR "PigStreaming.pl: processing $_\n";
      if (($cnt > 100) && ($pos eq "middle"))

      { print STDERR "Failed in the middle of processing\n"; exit(2); }

      }

      print STDERR "Failed at the end of processing\n";
      exit(3);

        Attachments

        1. PIG-232_2_20080508.patch
          7 kB
          Arun C Murthy
        2. PIG-232_1_20080507.patch
          0.9 kB
          Arun C Murthy
        3. PIG-232_0_20080507.patch
          0.9 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              olgan Olga Natkovich
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: