[SPARK-34231] AvroSuite has test failure when run from IDE due to bad loading of resource file

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 2.4.8, 3.0.2, 3.1.1
• Component/s: SQL, Tests
• Assignee: Erik Krogen
• Reporter: Erik Krogen
• Created: 25/Jan/21 21:58
• Updated: 12/Dec/22 18:10
• Resolved: 27/Jan/21 07:19

Description

Within AvroSuite the test Ignore corrupt Avro file if flag IGNORE_CORRUPT_FILES enabled attempts to load a resource file like:

        val srcFile = new File("src/test/resources/episodes.avro")
        val destFile = new File(dir, "episodes.avro")
        FileUtils.copyFile(srcFile, destFile)

This works okay when tests are run via Maven/sbt , but really isn't the right way to access a resource, causing failures when run via IntelliJ, and actually episodes.avro has already been loaded properly as episodesAvro. Switch over to loading it properly:

        Files.copy(
          Paths.get(new URL(episodesAvro).toURI),
          Paths.get(dir.getCanonicalPath, "episodes.avro"))

Issue Links

• links to: [Github] Pull Request #31332 (xkrogen)
• links to: [Github] Pull Request #31332 (xkrogen)