[SPARK-20539] support optional dataframe name

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: PJ Fanning
• Created: 30/Apr/17 18:59
• Updated: 30/Apr/17 19:14
• Resolved: 30/Apr/17 19:14

Description

In the Spark UI and some exception logging, Dataframes are described using the schemas. This is very useful.
We use Spark SQL in an application where our customers can manipulate data. When we need to examine logs or check the Spark REST API or UI, we would prefer to be able to override the name of the Dataframe to be something that identifies the origin of the Dataframe as opposed to having the column names exposed. There is a small possibility that the column names could contain some Personally Identifiable Information.

Issue Links

• duplicates: SPARK-8480 Add setName for Dataframe