[HIVE-1394] do not update transient_lastDdlTime if the partition is modified by a housekeeping operation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.7.0
• Component/s: Query Processor
• Hadoop Flags: Reviewed
• Assignee: Ning Zhang
• Reporter: Namit Jain
• Created: 08/Jun/10 18:31
• Updated: 24/Oct/15 03:51
• Resolved: 23/Jun/10 00:45

Description

Currently. purging looks at the hdfs time to see the last time the files got modified.
It should look at the metastore property instead - these are facebook specific utilities, which do not require any changes to hive.

However, in some cases, the operation might be performed by some housekeeping job, which should not modify the timestamp.
Since, hive has no way of knowing the origin of the query, it might be a good idea to add a new hint which specifies that the
operation is a cleanup operation, and the timestamp in the metastore need not be touched for that scenario.

Issue Links

• is related to: HIVE-1442 HOLD_DDLTIME does not change partition metadata
• is related to: HIVE-12224 Remove HOLD_DDLTIME