[REEF-730] Fix issues with InProcessIMRU

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 0.13
• Fix Version/s: 0.13
• Component/s: REEF.NET

Environment

C#

• Assignee: Dhruv Mahajan
• Reporter: Dhruv Mahajan
• Created: 09/Sep/15 02:19
• Updated: 14/Sep/15 17:38
• Resolved: 14/Sep/15 17:38

Description

The aim of this JIRA is to keep In-Process IMRU up to date with current IMRUJobDefinition and On-REEF IMRU implementations since it is very useful for initial debugging of code. Specifically,

a) Codecs will be introduced so that there are no issues in case Map and Update tasks try to use/reuse the same fields in MapInput and MapOutput and codec functions are also debugged for On-REEF runs.

b) Per-Map configuration will be introduced to give mapper specific configuration also.

c) PartitionedDataset configuration will also be used and Partition configuration will be merged with each mapper configuration.

Dhruv