[HIVE-25362] LLAP: ensure tasks with locality have a chance to adjust delay

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: llap
• Labels: pull-request-available
• Assignee: Panagiotis Garefalakis
• Reporter: Panagiotis Garefalakis
• Created: 21/Jul/21 14:39
• Updated: 17/Nov/22 08:48
• Resolved: 08/Oct/21 13:45

Description

HIVE-24914 introduced a short-circuit optimization when all nodes are busy returning DELAYED_RESOURCES and reseting locality delay for a given tasks.

However, this may prevent tasks from adjusting their locality delay and being added to the DelayQueue leading sometimes to missed locality chances when all LLap resources are fully utilized.
To address the issue we should handle the two cases separately.

Issue Links

• links to: GitHub Pull Request #2513