Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-232

Number of input/output rows in the logs is invalid with BinaryStorage

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.1.0
    • None
    • None

    Description

      My pig script:

      define CMD `perl PigStreamingBad.pl end` ship('PigStreamingBad.pl') stderr('CMD' limit 1);
      A = load 'studenttab10k';
      B = stream A through CMD;
      store B into 'out';

      My perl script:

      use strict;

      1. This script is used to test streaming error cases in pig.
      2. Usage: PigStreaming.pl <start|middle|end>
      3. the parameter tells the application when to exit with error

      if ($#ARGV < 0)
      {
      print STDERR "Usage PigStreaming.pl <start|middle|end>\n";
      exit (-1);
      }

      my $pos = $ARGV[0];

      if ($pos eq "start")
      {
      print STDERR "Failed in the beginning of the processing\n";
      exit(1);
      }

      print STDERR "PigStreamingBad.pl: starting processing\n";

      my $cnt = 0;
      while (<STDIN>)
      {
      print "$_";
      $cnt++;
      print STDERR "PigStreaming.pl: processing $_\n";
      if (($cnt > 100) && ($pos eq "middle"))

      { print STDERR "Failed in the middle of processing\n"; exit(2); }

      }

      print STDERR "Failed at the end of processing\n";
      exit(3);

      Attachments

        1. PIG-232_2_20080508.patch
          7 kB
          Arun Murthy
        2. PIG-232_1_20080507.patch
          0.9 kB
          Arun Murthy
        3. PIG-232_0_20080507.patch
          0.9 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            olgan Olga Natkovich
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: