[SPARK-28589] Introduce a new type coercion mode by following PostgreSQL

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Gengliang Wang
• Created: 01/Aug/19 07:32
• Updated: 16/Mar/20 22:52

Description

The type coercion rules in Spark SQL are not consistent with any system. Sometimes, it is confusing to end users. 

We can introduce a new type coercion mode so that Spark can function as some popular DBMS. For example, PostgreSQL.

Sub-Tasks

• Introduce ANSI store assignment policy for table insertion: Resolved
• Return null result on cast an out-of-range value to a integral type: Resolved
• New optional mode: throw runtime exceptions on casting failures: Resolved
• Configurable type coercion policy for table insertion: Resolved
• New optional mode: Throw exceptions when casting to integers causes overflow: Resolved
• Follow ANSI store assignment rules in table insertion by default: Resolved
• ANSI store assignment policy: throw exception on insertion failure: Resolved
• store assignable if there exists an appropriate user-defined cast function: Resolved