[SPARK-42971] When processing the WorkDirCleanup event, if appDirs is empty, should print workdir

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0, 3.5.0
• Fix Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Yang Jie
• Reporter: Yang Jie
• Created: 30/Mar/23 00:48
• Updated: 30/Mar/23 04:53
• Resolved: 30/Mar/23 04:53

Description

          val appDirs = workDir.listFiles()
          if (appDirs == null) {
            throw new IOException(
              s"ERROR: Failed to list files in ${appDirs.mkString("dirs(", ", ", ")")}")
          }

 

Otherwise, npe will be thrown here when appDirs is null

 

Issue Links

• links to: [Github] Pull Request #40597 (LuciferYang)