[SPARK-19736] refreshByPath should clear all cached plans with the specified path

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.1, 2.2.0
• Component/s: SQL
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 25/Feb/17 05:53
• Updated: 17/Mar/17 02:59
• Resolved: 01/Mar/17 08:20

Description

Catalog.refreshByPath can refresh the cache entry and the associated metadata for all dataframes (if any), that contain the given data source path.

However, CacheManager.invalidateCachedPath doesn't clear all cached plans with the specified path. It causes some strange behaviors reported in SPARK-15678.

Issue Links

• links to: [Github] Pull Request #17064 (viirya)