Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18878 Fix/investigate the more identified test failures in Java/Scala on Windows
  3. SPARK-18922

Fix more resource-closing-related and path-related test failures in identified ones on Windows

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: Tests
    • Labels:
      None

      Description

      There are more instances that are failed on Windows as below:

      • LauncherBackendSuite:
      - local: launcher handle *** FAILED *** (30 seconds, 120 milliseconds)
        The code passed to eventually never returned normally. Attempted 283 times over 30.0960053 seconds. Last failure message: The reference was null. (LauncherBackendSuite.scala:56)
        org.scalatest.exceptions.TestFailedDueToTimeoutException:
        at org.scalatest.concurrent.Eventually$class.tryTryAgain$1(Eventually.scala:420)
        at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:438)
      
      - standalone/client: launcher handle *** FAILED *** (30 seconds, 47 milliseconds)
        The code passed to eventually never returned normally. Attempted 282 times over 30.037987100000002 seconds. Last failure message: The reference was null. (LauncherBackendSuite.scala:56)
        org.scalatest.exceptions.TestFailedDueToTimeoutException:
        at org.scalatest.concurrent.Eventually$class.tryTryAgain$1(Eventually.scala:420)
        at org.scalatest.concurrent.Eventually$class.eventually(Eventually.scala:438)
      
      • SQLQuerySuite:
      - specifying database name for a temporary table is not allowed *** FAILED *** (125 milliseconds)
        org.apache.spark.sql.AnalysisException: Path does not exist: file:/C:projectsspark  arget mpspark-1f4471ab-aac0-4239-ae35-833d54b37e52;
        at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
        at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
      
      • JsonSuite:
      - Loading a JSON dataset from a text file with SQL *** FAILED *** (94 milliseconds)
        org.apache.spark.sql.AnalysisException: Path does not exist: file:/C:projectsspark  arget mpspark-c918a8b7-fc09-433c-b9d0-36c0f78ae918;
        at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:382)
        at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$14.apply(DataSource.scala:370)
      
      • StateStoreSuite:
      - SPARK-18342: commit fails when rename fails *** FAILED *** (16 milliseconds)
        java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: StateStoreSuite29777261fs://C:%5Cprojects%5Cspark%5Ctarget%5Ctmp%5Cspark-ef349862-7281-4963-aaf3-add0d670a4ad%5C?????-2218c2f8-2cf6-4f80-9cdf-96354e8246a77685899733421033312/0
        at org.apache.hadoop.fs.Path.initialize(Path.java:206)
        at org.apache.hadoop.fs.Path.<init>(Path.java:116)
        at org.apache.hadoop.fs.Path.<init>(Path.java:89)
        ...
        Cause: java.net.URISyntaxException: Relative path in absolute URI: StateStoreSuite29777261fs://C:%5Cprojects%5Cspark%5Ctarget%5Ctmp%5Cspark-ef349862-7281-4963-aaf3-add0d670a4ad%5C?????-2218c2f8-2cf6-4f80-9cdf-96354e8246a77685899733421033312/0
        at java.net.URI.checkPath(URI.java:1823)
        at java.net.URI.<init>(URI.java:745)
        at org.apache.hadoop.fs.Path.initialize(Path.java:203)
      
      • HDFSMetadataLogSuite:
      - FileManager: FileContextManager *** FAILED *** (94 milliseconds)
        java.io.IOException: Failed to delete: C:\projects\spark\target\tmp\spark-415bb0bd-396b-444d-be82-04599e025f21
        at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:1010)
        at org.apache.spark.sql.test.SQLTestUtils$class.withTempDir(SQLTestUtils.scala:127)
        at org.apache.spark.sql.execution.streaming.HDFSMetadataLogSuite.withTempDir(HDFSMetadataLogSuite.scala:38)
      - FileManager: FileSystemManager *** FAILED *** (78 milliseconds)
        java.io.IOException: Failed to delete: C:\projects\spark\target\tmp\spark-ef8222cd-85aa-47c0-a396-bc7979e15088
        at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:1010)
        at org.apache.spark.sql.test.SQLTestUtils$class.withTempDir(SQLTestUtils.scala:127)
        at org.apache.spark.sql.execution.streaming.HDFSMetadataLogSuite.withTempDir(HDFSMetadataLogSuite.scala:38)
      

      Please refer, for full logs, https://ci.appveyor.com/project/spark-test/spark/build/283-tmp-test-base

        Attachments

          Activity

            People

            • Assignee:
              hyukjin.kwon Hyukjin Kwon
              Reporter:
              hyukjin.kwon Hyukjin Kwon
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: