[SPARK-38305] Check existence of file before untarring/zipping

• Type: Improvement
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 3.2.1
• Fix Version/s: 3.3.0, 3.1.4, 3.2.2
• Component/s: Spark Core
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 23/Feb/22 16:29
• Updated: 29/Sep/22 13:19
• Resolved: 25/Feb/22 14:35

Description

Some discussion related to Hadoop revealed that its FileUtil.unTar and unZip methods might have a problem if the source file does not actually exist.

It's trivial to check for this in the one place we use it in Spark, and just explicitly error if the source file does not exist.

Issue Links

• is related to: HADOOP-18136 Verify FileUtils.unTar() handling of missing .tar files: Fixes CVE-2022-25168
• links to: [Github] Pull Request #35632 (srowen)
• links to: [Github] Pull Request #35632 (srowen)