[SPARK-33018] Fix compute statistics issue

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.0.1, 3.1.0
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: SQL
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 28/Sep/20 15:35
• Updated: 29/Sep/20 16:46
• Resolved: 29/Sep/20 16:46

Description

The statistics may be incorrect if it contains 0.
https://github.com/apache/spark/blob/98be8953c75c026c1cb432cc8f66dd312feed0c6/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/SizeInBytesOnlyStatsPlanVisitor.scala#L54-L58

Issue Links

• links to: [Github] Pull Request #29894 (wangyum)
• links to: [Github] Pull Request #29894 (wangyum)