[HIVE-24116] LLAP: Provide an opportunity for preempted tasks to get better locality in next iteration

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: llap
• Labels: pull-request-available
• Assignee: Rajesh Balamohan Assign to me
• Reporter: Rajesh Balamohan
• Created: 03/Sep/20 10:10
• Updated: 17/Nov/22 08:48
• Resolved: 04/Sep/20 08:59

Description

In certain DAGs, tasks get preempted as higher priority tasks need to be executed. These preempted tasks are scheduled to run later, but they end up missing locality information. Ref: HIVE-24061

Remote storage reads can be avoided, if an opportunity is provided for these preempted to get better locality in next iteration.

 

Issue Links

• links to: GitHub Pull Request #1466