[HIVE-2866] Cache local map reduce job errors for additional logging

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Logging
• Hadoop Flags: Reviewed
• Assignee: Kevin Wilfong
• Reporter: Kevin Wilfong
• Created: 13/Mar/12 00:09
• Updated: 09/Jan/13 10:25
• Resolved: 31/Mar/12 14:32

Description

Using the CachingPrintStream we are storing errors that occur locally in Hive, but because local map reduce jobs are run in a separate JVM we are not storing that occur for these. We can use this same construct to store errors written to the subprocesses error stream. This way, when we log failed queries, these will give us a decent idea of why those queries failed.

See related issues:
https://issues.apache.org/jira/browse/HIVE-2832
https://issues.apache.org/jira/browse/HIVE-2858