[HIVE-23122] LLAP: TaskExecutorService should log details about task eviction decision details

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: llap
• Assignee: László Bodor
• Reporter: László Bodor
• Created: 01/Apr/20 11:42
• Updated: 17/Nov/22 08:51
• Resolved: 07/Apr/20 12:41

Description

TaskExecutorService maintains a waitQueue, and can evict a task in favor of another. Under the hood, the queue uses a configurable comparator. The currently available comparators typically use the following properties of a task(wrapper):
getWithinDagPriority: related to vertex
currentAttemptStartTime
firstAttemptStartTime
knownPending: remaining upstream tasks

The problem is, when an eviction happens, the INFO level message doesn't provide any insight about the decision, only attempts ids like below:

attempt_1585248378306_0010_72_02_000096_8 evicted from wait queue in favor of attempt_1585248378306_0003_175_02_000079_175 because of lower priority

Issue Links

• is fixed by: HIVE-24192 Properly log TaskExecutorService eviction details