Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
TaskExecutorService maintains a waitQueue, and can evict a task in favor of another. Under the hood, the queue uses a configurable comparator. The currently available comparators typically use the following properties of a task(wrapper):
getWithinDagPriority: related to vertex
currentAttemptStartTime
firstAttemptStartTime
knownPending: remaining upstream tasks
The problem is, when an eviction happens, the INFO level message doesn't provide any insight about the decision, only attempts ids like below:
attempt_1585248378306_0010_72_02_000096_8 evicted from wait queue in favor of attempt_1585248378306_0003_175_02_000079_175 because of lower priority
Attachments
Attachments
Issue Links
- is fixed by
-
HIVE-24192 Properly log TaskExecutorService eviction details
- Closed