[SPARK-50137] Avoid fallback to Hive-incompatible ways when table creation fails by thrift exception

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.5.3
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Wechar
• Created: 26/Oct/24 16:15
• Updated: 30/Oct/24 09:08

Description

When creating datasource table by HiveExternalCatalog, Spark would fall back to create table in hive incompatible way for all nonfatal exceptions. This is incorrect for thrift exceptions caused by connection issues, where we could still attempt to create table in hive compatible way by retry mechanism.

Issue Links

• links to: GitHub Pull Request #48668