[SPARK-28555] Recover options and properties and pass them back into the v1 API

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Xin Ren
• Created: 29/Jul/19 17:33
• Updated: 29/Jul/19 17:35

Description

When tables are created, the CREATE TABLE syntax supports both TBLPROPERTIES and OPTIONS. Options were used in v1 to configure the table itself, like options passed to DataFrameReader. Right now, both properties and options are stored in v2 table properties, because v2 only has properties, not both. But, we aren't able to recover which properties were set through OPTIONS and which were set through TBLPROPERTIES.

Instead of the current behavior, I think options should be prefixed with option.. That way, we can recover options and properties and pass them back into the v1 API.