[SPARK-22089] There is no need for fileStatusCache to invalidateAll when InMemoryFileIndex refresh

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: guichaoxian
• Created: 21/Sep/17 13:23
• Updated: 22/Sep/17 14:34
• Resolved: 22/Sep/17 06:44

Description

the fileStatusCache is globally shared cache，refresh is only for one table，so we do not need to invalidateAll entry in fileStatusCache

  /** Globally shared (not exclusive to this table) cache for file statuses to speed up listing. */
  private val fileStatusCache = FileStatusCache.getOrCreate(sparkSession)

 override def refresh(): Unit = {
    refresh0()
    fileStatusCache.invalidateAll()
  }