[PIG-232] Number of input/output rows in the logs is invalid with BinaryStorage

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.1.0
• Assignee: Arun Murthy
• Reporter: Olga Natkovich
• Created: 07/May/08 00:33
• Updated: 24/Mar/10 22:01
• Resolved: 09/May/08 16:19

Description

My pig script:

define CMD `perl PigStreamingBad.pl end` ship('PigStreamingBad.pl') stderr('CMD' limit 1);
A = load 'studenttab10k';
B = stream A through CMD;
store B into 'out';

My perl script:

use strict;

1. This script is used to test streaming error cases in pig.
2. Usage: PigStreaming.pl <start|middle|end>
3. the parameter tells the application when to exit with error

if ($#ARGV < 0)
{
print STDERR "Usage PigStreaming.pl <start|middle|end>\n";
exit (-1);
}

my $pos = $ARGV[0];

if ($pos eq "start")
{
print STDERR "Failed in the beginning of the processing\n";
exit(1);
}

print STDERR "PigStreamingBad.pl: starting processing\n";

my $cnt = 0;
while (<STDIN>)
{
print "$_";
$cnt++;
print STDERR "PigStreaming.pl: processing $_\n";
if (($cnt > 100) && ($pos eq "middle"))

{ print STDERR "Failed in the middle of processing\n"; exit(2); }

}

print STDERR "Failed at the end of processing\n";
exit(3);