[SPARK-32978] Incorrect number of dynamic part metric

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: SQL
• Assignee: Yang Jie
• Reporter: Yuming Wang
• Created: 23/Sep/20 16:05
• Updated: 22/Oct/20 14:02
• Resolved: 22/Oct/20 14:01

Description

How to reproduce this issue:

create table dynamic_partition(i bigint, part bigint) using parquet partitioned by (part);
insert overwrite table dynamic_partition partition(part) select id, id % 50 as part  from range(10000);

The number of dynamic part should be 50, but it is 800 on web UI.

Issue Links

• links to: [Github] Pull Request #30026 (LuciferYang)
• links to: [Github] Pull Request #30026 (LuciferYang)