[CRUNCH-278] Improvements to MapsideJoin code

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.0
• Component/s: Core, MapReduce Patterns
• Assignee: Josh Wills
• Reporter: Josh Wills
• Created: 10/Oct/13 07:18
• Updated: 08/Nov/13 21:24
• Resolved: 23/Oct/13 14:43

Description

The fact that we have special-case code in the MapsideJoinStrategy for the in-memory and MR-based Pipeline instances has always bugged me, so I set out to eliminate the distinction between the two impls by creating a new interface, ReadableSourceBundle<T>, that encapsulates the MR and in-memory specific logic for doing mapside joins in order to remove the special-case code in MapsideJoinStrategy and hopefully make other implementations that use our mapside-join patterns much easier to test.

Issue Links

• is related to: CRUNCH-287 Switch some internal APIs to use the new ReadableData iface