Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14183

hive 2.1.0 beeline cannot show verbose log

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • 2.1.0
    • None
    • Beeline, HiveServer2
    • None
    • set hive.async.log.enabled=false; the verbose log can show normally

    Description

      In Hive 1.2.1 , config the log verbose , the beeline client will show the verbose log like this:

      16/07/07 13:29:33 INFO mapreduce.Job: The url to track the job: http://host:8088/proxy/application_1467708727273_0035/
      16/07/07 13:29:33 INFO exec.Task: Starting Job = job_1467708727273_0035, Tracking URL = http://host:8088/proxy/application_1467708727273_0035/
      16/07/07 13:29:33 INFO exec.Task: Kill Command = /hadoop/hadoop-2.7.2/bin/hadoop job -kill job_1467708727273_0035
      16/07/07 13:30:07 INFO exec.Task: Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
      16/07/07 13:30:07 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
      16/07/07 13:30:07 INFO exec.Task: 2016-07-07 13:30:07,905 Stage-1 map = 0%, reduce = 0%
      16/07/07 13:30:17 INFO exec.Task: 2016-07-07 13:30:17,757 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 2.39 sec
      16/07/07 13:30:28

      the verbose config:

      <property>
      <name>hive.server2.logging.operation.enabled</name>
      <value>true</value>
      <description>When true, HS2 will save operation logs and make them available for clients</description>
      </property>
      <property>
      <name>hive.server2.logging.operation.log.location</name>
      <value>/hadooplog/apache-hive-1.2.1-bin/operation_logs</value>
      <description>Top level directory where operation logs are stored if logging functionality is enabled</description>
      </property>
      <property>
      <name>hive.server2.logging.operation.level</name>
      <value>VERBOSE</value>
      <description>
      Expects one of [none, execution, performance, verbose].
      HS2 operation logging mode available to clients to be set at session level.
      For this to work, hive.server2.logging.operation.enabled should be set to true.
      NONE: Ignore any logging
      EXECUTION: Log completion of tasks
      PERFORMANCE: Execution + Performance logs
      VERBOSE: All logs
      </description>
      </property>

      However, when upgrade to hive 2.1.0, with the same verbose configure, the verbose log cannot show.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prasanth_j Prasanth Jayachandran Assign to me
            huasanyelao jack

            Dates

              Created:
              Updated:

              Slack

                Issue deployment