[SPARK-19370] Flaky test: MetadataCacheSuite

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.1.0
• Labels: bulk-closed
• Assignee: Shixiong Zhu
• Reporter: Davies Liu
• Created: 26/Jan/17 16:39
• Updated: 21/May/19 04:14
• Resolved: 21/May/19 04:14

Description

https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-hadoop-2.4/2703/consoleFull

MetadataCacheSuite:
- SPARK-16336 Suggest doing table refresh when encountering FileNotFoundException
Exception encountered when invoking run on a nested suite - There are 1 possibly leaked file streams. *** ABORTED ***
  java.lang.RuntimeException: There are 1 possibly leaked file streams.
  at org.apache.spark.DebugFilesystem$.assertNoOpenStreams(DebugFilesystem.scala:47)
  at org.apache.spark.sql.test.SharedSQLContext$class.afterEach(SharedSQLContext.scala:90)
  at org.apache.spark.sql.MetadataCacheSuite.afterEach(MetadataCacheSuite.scala:29)
  at org.scalatest.BeforeAndAfterEach$class.afterEach(BeforeAndAfterEach.scala:205)
  at org.apache.spark.sql.MetadataCacheSuite.afterEach(MetadataCacheSuite.scala:29)
  at org.scalatest.BeforeAndAfterEach$class.afterEach(BeforeAndAfterEach.scala:220)
  at org.apache.spark.sql.MetadataCacheSuite.afterEach(MetadataCacheSuite.scala:29)
  at org.scalatest.BeforeAndAfterEach$class.runTest(BeforeAndAfterEach.scala:264)
  at org.apache.spark.sql.MetadataCacheSuite.runTest(MetadataCacheSuite.scala:29)
  at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208)
  ...