Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-37935 Migrate onto error classes
  3. SPARK-41311

Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • SQL
    • None

    Description

      Rewrite the test for error class RENAME_SRC_PATH_NOT_FOUND in QueryExecutionErrorsSuite.scala to trigger the error from user space. The current test uses non-user-facing class FileSystemBasedCheckpointFileManager directly to trigger the error. (see https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680 )

      Done when: the test uses user-facing APIs as much as possible.

      Proposed solution: rewrite the test following the example of https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641

      See https://github.com/apache/spark/pull/38782#discussion_r1033013064 for more context

      Attachments

        Activity

          People

            ibuder Immanuel Buder
            ibuder Immanuel Buder
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: