[HUDI-6828] After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0-beta1, 0.14.1
• Labels: pull-request-available
• Assignee: Jing Zhang
• Reporter: Jing Zhang
• Created: 07/Sep/23 03:41
• Updated: 09/Oct/23 02:58
• Resolved: 09/Oct/23 02:58

Description

After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect
For example, current dataset of partition dt=2021-07-17 is

id	name	dt
1	'a'	'2021-07-17'

Using the following SQL to overwrite partition dt=2021-07-17

insert overwrite table targetT partition(dt='2021-07-17') select id, name, price from sourceT where  dt=2021-07-17 and product='test'

If the input dataset is empty. We expect after insert overwrite, the partition of dt=2021-07-17 is empty.
However, the query result is still the old data.

Issue Links

• links to: GitHub Pull Request #9811