[HADOOP-3104] MultithreadMapRunner keeps consuming records even if trheads are not available

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.16.1
• Fix Version/s: 0.16.2

Environment

all

• Assignee: Alejandro Abdelnur
• Reporter: Alejandro Abdelnur
• Created: 27/Mar/08 07:26
• Updated: 03/Apr/08 15:42
• Resolved: 28/Mar/08 21:16

Description

The ExecutorService execute() method does not block when there are not threads available, it queues up the runnables until there are threads.

The problem is that all key/values are read and kept in memory for the task, with large datasets this will create a OOM exception.

Have to figure out how to use the execute in blocking fashion.