[SPARK-34970] Redact map-type options in the output of explain()

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.1.1
• Fix Version/s: 3.0.3, 3.1.2, 3.2.0
• Component/s: Security, SQL
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 06/Apr/21 13:32
• Updated: 08/Apr/21 03:23
• Resolved: 07/Apr/21 16:56

Description

The `explain()` method prints the arguments of tree nodes in logical/physical plans. The arguments could contain a map-type option which contains sensitive data.
We should map-type options in the output of explain(), otherwise we will see sensitive data in explain output or Spark UI.

Issue Links

• links to: [Github] Pull Request #32066 (gengliangwang)
• links to: [Github] Pull Request #32079 (gengliangwang)
• links to: [Github] Pull Request #32085 (gengliangwang)
• links to: [Github] Pull Request #32085 (gengliangwang)