[IMPALA-11443] Possible overflow in SortNode.java

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.2.0, Impala 4.1.1
• Component/s: Frontend
• Epic Color: ghx-label-9
• Assignee: Csaba Ringhofer
• Reporter: Daniel Becker
• Created: 18/Jul/22 16:25
• Updated: 16/Jan/23 01:46
• Resolved: 22/Jul/22 21:37

Description

At line
https://github.com/apache/impala/blob/d029ae53676c8637bc4f56b80b331920c8289108/fe/src/main/java/org/apache/impala/planner/SortNode.java#L514

the following precondition check was triggered in ResourceProfileBuilder:

Preconditions.checkState(memEstimateBytes_ >= 0, "Mem estimate must be set");

See https://github.com/apache/impala/blob/d029ae53676c8637bc4f56b80b331920c8289108/fe/src/main/java/org/apache/impala/planner/ResourceProfileBuilder.java#L79

This may be due to corrupt statistics but further investigation is necessary.

Issue Links

• is caused by: IMPALA-9979 Backend partitioned top-n operator