Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2866

Cache local map reduce job errors for additional logging

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: Logging
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Using the CachingPrintStream we are storing errors that occur locally in Hive, but because local map reduce jobs are run in a separate JVM we are not storing that occur for these. We can use this same construct to store errors written to the subprocesses error stream. This way, when we log failed queries, these will give us a decent idea of why those queries failed.

      See related issues:
      https://issues.apache.org/jira/browse/HIVE-2832
      https://issues.apache.org/jira/browse/HIVE-2858

        Attachments

          Activity

            People

            • Assignee:
              kevinwilfong Kevin Wilfong
              Reporter:
              kevinwilfong Kevin Wilfong
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: