[PIG-3295] Casting from bytearray failing after Union (even when each field is from a single Loader)

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.13.0
• Component/s: parser
• Hadoop Flags: Reviewed
• Release Note: Before, LoadCaster after Union was only available when two union-ed relations were from the same Loader with same parameters. Now, LoadCaster would work for cases when Loaders return the same LoadCaster that only have a default constructor.
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 24/Apr/13 21:30
• Updated: 07/Jul/14 18:07
• Resolved: 30/Oct/13 15:28

Description

One example

A = load 'data1.txt' as line:bytearray;
B = load 'c1.txt' using TextLoader() as cookie1;
C = load 'c2.txt' using TextLoader() as cookie2;
B2 = join A by line, B by cookie1;
C2 = join A by line, C by cookie2;
D = union onschema B2,C2; -- D: {A::line: bytearray,B::cookie1: bytearray,C::cookie2: bytearray}
E = foreach D generate (chararray) line, (chararray) cookie1, (chararray) cookie2;
dump E;

This script fails at runtime with
"Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 1075: Received a bytearray from the UDF. Cannot determine how to convert the bytearray to string."

This is different from PIG-3293 such that each field in 'D' belongs to a single loader whereas on PIG-3293, it came from multiple loader.

Issue Links

• is duplicated by: PIG-3293 Casting fails after Union from two data sources&loaders