Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8600

Add option to log explain output for query

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      When diagnosing issues, it is useful to have the explain output for the query already available in log4j log.

      1. HIVE-8600.patch
        4 kB
        Mohit Sabharwal

        Issue Links

          Activity

          Hide
          mohitsabharwal Mohit Sabharwal added a comment -

          Attached patch adds an option to log the EXPLAIN EXTENDED output after the query has been semantically analyzed. It re-uses ExplainTask code that prints the plan.

          Show
          mohitsabharwal Mohit Sabharwal added a comment - Attached patch adds an option to log the EXPLAIN EXTENDED output after the query has been semantically analyzed. It re-uses ExplainTask code that prints the plan.
          Hide
          hiveqa Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12677053/HIVE-8600.patch

          ERROR: -1 due to 1 failed/errored test(s), 6578 tests executed
          Failed tests:

          org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1459/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1459/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1459/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12677053 - PreCommit-HIVE-TRUNK-Build

          Show
          hiveqa Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12677053/HIVE-8600.patch ERROR: -1 due to 1 failed/errored test(s), 6578 tests executed Failed tests: org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1459/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1459/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1459/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12677053 - PreCommit-HIVE-TRUNK-Build
          Hide
          brocknoland Brock Noland added a comment -

          Nice!! +1

          Show
          brocknoland Brock Noland added a comment - Nice!! +1
          Hide
          leftylev Lefty Leverenz added a comment -

          Doc note: This adds configuration parameter hive.log.explain.output to HiveConf.java, so it needs to be documented in the wiki.

          Show
          leftylev Lefty Leverenz added a comment - Doc note: This adds configuration parameter hive.log.explain.output to HiveConf.java, so it needs to be documented in the wiki. Language Manual – Explain Configuration Properties – Query and DDL Execution Getting Started – Logs
          Hide
          leftylev Lefty Leverenz added a comment -

          Karen Coppage documented hive.log.explain.output in the Explain doc and Configuration Properties (thanks, Karen!) and I added a sentence about it in the Hive Logging section of Getting Started.

          Here's a direct link to the parameter in Configuration Properties:

          Removed the TODOC15 label.

          Show
          leftylev Lefty Leverenz added a comment - Karen Coppage documented hive.log.explain.output in the Explain doc and Configuration Properties (thanks, Karen!) and I added a sentence about it in the Hive Logging section of Getting Started. Here's a direct link to the parameter in Configuration Properties: hive.log.explain.output Removed the TODOC15 label.

            People

            • Assignee:
              mohitsabharwal Mohit Sabharwal
              Reporter:
              mohitsabharwal Mohit Sabharwal
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development