[HIVE-23467] Add a skip.trash config for HMS to skip trash when deleting external table data

• Type: Improvement
• Status: Closed
• Priority: Trivial
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: Hive
• Labels: pull-request-available
• Assignee: Yu-Wen Lai
• Reporter: Sam An
• Created: 13/May/20 23:35
• Updated: 17/Nov/22 08:47
• Resolved: 25/Jun/20 12:29

Description

We have an auto.purge flag, which means skip trash. It can be confusing as we have 'external.table.purge'='true' to indicate delete table data when this tblproperties is set. 

We should make the meaning clearer by introducing a skip trash alias/option. 

Additionally, we shall add an alias for external.table.purge, and name it external.table.autodelete, and document it more prominently, so as to maintain backward compatibility, and make the meaning of auto deletion of data more obvious. 

The net effect of these 2 changes will be. If the user sets 

'external.table.autodelete'='true'

the table data will be removed when table is dropped. and if 

'skip.trash'='true' 

is set, HMS will not move the table data to trash folder when removing the files. This will result in faster removal, especially when underlying FS is S3. 

Issue Links

• links to: GitHub Pull Request #1133