Pig
  1. Pig
  2. PIG-2374

streaming regression with dotNext

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.2
    • Component/s: None
    • Labels:
    • Environment:
    • Hadoop Flags:
      Reviewed

      Description

      Streaming seems to be broken in dotNext. There are several tests that are failing.
      The results from C below produce clean results.
      The results from D which are streamed through CMD produce control characters on some of the output.

      define CMD `perl GroupBy.pl '\t' 0` ship('/homes/monster/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/GroupBy.pl');
      A = load '/user/user1/pig/tests/data/singlefile/studenttab10k';
      B = group A by $0;
      C = foreach B generate flatten(A);
      D = stream C through CMD;
      store C into '/user/user1/pig/out/user1.1321117428/ComputeSpec_7_C.out';
      store D into '/user/user1/pig/out/user1.1321117428/ComputeSpec_7_D.out';

      Other streaming tests that fail with control characters:
      EST FAILED <ComputeSpec_7>
      TEST FAILED <ComputeSpec_8>
      TEST FAILED <ComputeSpec_10>
      TEST FAILED <ComputeSpec_11>
      TEST FAILED <ComputeSpec_12>
      TEST FAILED <JobManagement_2>
      TEST FAILED <JobManagement_3>
      TEST FAILED <StreamingIO_4>
      TEST FAILED <NonStreaming_1>
      TEST FAILED <MultiQuery_21>
      ...

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Daniel Dai
              Reporter:
              Araceli Henley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development