Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.14.4, 1.15.1
Description
In the Hive dimension table, when the data is changed on the original partition, the create_time configuration does not take effect.
The current table structure directory is as follows:
From the above figure, we can know that when hive is a dimension table, it will load the data of dt=2021-04-22, hr=27.
If a new partition arrives now, the data of the latest partition can be read smoothly. However, if the data is modified on the original partition, theoretically, the data of the modified partition is read, because of the create_time and latest configuration, but this is not the case in practice. The data that was originally loaded is still read.
