[SPARK-29283] Error message is hidden when query from JDBC, especially enabled adaptive execution

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Lantao Jin
• Reporter: Lantao Jin
• Created: 29/Sep/19 06:33
• Updated: 17/Oct/19 02:55
• Resolved: 17/Oct/19 02:54

Description

When adaptive execution is enabled, the Spark users who connected from JDBC always get adaptive execution error whatever the under root cause is. It's very confused. We have to check the driver log to find out why.

0: jdbc:hive2://localhost:10000> SELECT * FROM testData join testData2 ON key = v;
SELECT * FROM testData join testData2 ON key = v;
Error: Error running query: org.apache.spark.SparkException: Adaptive execution failed due to stage materialization failures. (state=,code=0)
0: jdbc:hive2://localhost:10000> 

For example, a job queried from JDBC failed due to HDFS missing block. User still get the error message Adaptive execution failed due to stage materialization failures.

Issue Links

• links to: GitHub Pull Request #25960