[TEZ-1876] [Umbrella] Polish up support for local mode in Tez

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Hitesh Shah
• Created: 19/Dec/14 21:30
• Updated: 28/Jan/15 00:43

Description

Finish up all pending work from TEZ-684

Issue Links

• relates to: TEZ-1184 [Umbrella] Support for multiple tasks running in the same JVM
• relates to: TEZ-2003 [Umbrella] Allow Tez to co-ordinate execution to external services

Sub-Tasks

• Fix memory issues for Local Mode running concurrent tasks: Closed
• Investigate independent parallel DAGs execution in Local Mode: Open
• Local mode does not work for MapReduce jobs (jobClient): Open
• Make use of the regular scheduler when running in LocalMode: Open
• Allow Tez local mode to run against filesystems other than local FS: Resolved
• Handling of LocalResources in LocalMode: Open
• Handling of local-dirs for Local Mode: Reopened
• Avoid interacting with the DAGAppMaster via RPC: Open
• move the uber/local mode check into vertex level: Open
• Create local UGI instances for each task and the AM, when running in LocalMode: Closed
• ObjectRegistry handling for multiple containers in LocalMode: Open
• Running out of threads in tez local mode: Closed
• LocalContainerLauncher should interrupt running tasks rather than using Future.cancel: Open
• TaskReporter and ContainerReporter should handle interrupts better: Open
• Stop the DAGAppMaster when a local mode client is stopped: Closed
• Simplify configuration handling to enable local mode: Resolved
• Support context logging while running in LocalMode: Open