[SPARK-23506] Add refreshByPath in HiveMetastoreCatalog and invalidByPath in FileStatusCache

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.1.0
• Component/s: SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: guichaoxian
• Created: 24/Feb/18 07:53
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

As far as I know HiveMetastoreCatalog only have a method called refreshTable,this method will remove all meta of a table cached in memory.

In some situation, I only change files of a partition. use refreshTable to invalid all file status is Inefficient.

I think we can add a method called invalidByPath in FileStatusCache and a method refreshByPath in HiveMetastoreCatalog.