[SPARK-27711] InputFileBlockHolder should be unset at the end of tasks

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.3
• Fix Version/s: 2.4.4, 3.0.0
• Component/s: PySpark, Spark Core
• Assignee: Jose Torres
• Reporter: Jose Torres
• Created: 14/May/19 18:51
• Updated: 26/May/19 00:30
• Resolved: 26/May/19 00:27

Description

InputFileBlockHolder should be unset at the end of each task. Otherwise the value of input_file_name() can leak over to other tasks instead of beginning as empty string.

Issue Links

• links to: GitHub Pull Request #24605
• links to: GitHub Pull Request #24690