[HIVE-1032] Better Error Messages for Execution Errors

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.6.0
• Component/s: Diagnosability, Query Processor
• Hadoop Flags: Reviewed
• Assignee: Paul Yang
• Reporter: Paul Yang
• Created: 07/Jan/10 03:24
• Updated: 17/Dec/11 00:03
• Resolved: 25/Feb/10 23:45

Description

Three common errors that occur during execution are:

1. Map-side group-by causing an out of memory exception due to large aggregation hash tables

2. ScriptOperator failing due to the user's script throwing an exception or otherwise returning a non-zero error code

3. Incorrectly specifying the join order of small and large tables, causing the large table to be loaded into memory and producing an out of memory exception.

These errors are typically discovered by manually examining the error log files of the failed task. This task proposes to create a feature that would automatically read the error logs and output a probable cause and solution to the command line.

Issue Links

• relates to: HIVE-862 CommandProcessor should return DriverResponse