[TEZ-1184] [Umbrella] Support for multiple tasks running in the same JVM

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Siddharth Seth
• Created: 06/Jun/14 22:53
• Updated: 28/Jan/15 00:43

Description

Umbrella to track issues that need to be resolved to support this.

Issue Links

• is related to: TEZ-1876 [Umbrella] Polish up support for local mode in Tez
• is related to: TEZ-1752 Inputs / Outputs in the Runtime library should be interruptable
• relates to: TEZ-2003 [Umbrella] Allow Tez to co-ordinate execution to external services

Sub-Tasks

• LocalDirAllocator for multiple threads in a JVM: Resolved
• Use a single RPC connection to the same AM: Open
• Add a framework ExecutorService which shares threads.: Closed
• Log file handling for multiple tasks per JVM: Open
• Support pushing work to a running container, rather than the getTask poll: Closed
• Memory provided by *Context.getAvailableMemory needs to be setup explicitly: Closed
• Setup fetchers to use shared executor.: Closed