[SAMZA-916] Implement operator programing APIs to support join

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Yi Pan
• Created: 24/Mar/16 22:27
• Updated: 04/Oct/16 23:44
• Resolved: 04/Oct/16 23:44

Description

This is to implement programming APIs to support join in an operator DAG.

Some code example would be:

src1 = sourceStream.<T1>map(mapper);
src2 = new DataStream<T2>;
commonOutput = new DataStream<R>();
Join<T1, T2, R> joiner = new Join<T1, T2, R>((t1, t2)->myJoinCondition(t1, t2), (t1, t2)->myJoinMerger(t1, t2));
src1.join(joiner1, Join.Order.FIRST, commonOutput);
src2.join(joiner1, Join.Order.SECOND, commonOutput);
commonOutput.flatMap(flatMapper2);

Issue Links

• duplicates: SAMZA-914 Design and implement a composable operator APIs for direct programming of DAG in Java