[PIG-5333] LoadCaster sometimes not set for complex type

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.18.0
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 05/Apr/18 19:08
• Updated: 06/Apr/18 17:09
• Resolved: 06/Apr/18 17:09

Description

TypeCasting a bytearray field in the nested foreach below

A = load 'input.txt' as (a0:bytearray, a1:bytearray);
B = group A by (a0,a1);
C = FOREACH B GENERATE SIZE(A) as sizeofgroup, A;
SPLIT C into D if sizeofgroup > 2, Z OTHERWISE;

F = FOREACH D {
    F1 = FOREACH A generate (chararray) a0;
    GENERATE F1;
}

store F into '/tmp/output/F';
store Z into '/tmp/output/Z';

Fails with

Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 1075: Received a bytearray from the UDF or Union from two different Loaders. Cannot determine how to convert the bytearray to string for [a0[7,29]]
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POCast.getNextString(POCast.java:1126)