[PIG-4190] Implement replicated join in Spark engine

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: spark-branch
• Component/s: spark
• Assignee: Mohit Sabharwal
• Reporter: Praveen Rachabattuni
• Created: 22/Sep/14 10:30
• Updated: 21/Jun/17 09:18
• Resolved: 15/May/15 04:25

Description

Related e2e tests: Union_7, Union_8, Union_13

Sample script:
a = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
b = load '/user/pig/tests/data/singlefile/studentcolon10k' using PigStorage(':') as (name, age, gpa);
c = union a, b;
d = load '/user/pig/tests/data/singlefile/votertab10k' as (name, age, registration, contributions);
e = join c by name, d by name using 'replicated';
store e into '/user/pig/out/praveenr-1411380943-nightly.conf/Union_7.out';

Issue Links

• is duplicated by: PIG-4278 Enable unit test "TestFRJoin" for spark
• links to: review board