Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10119

Allow Log verbosity to be set in hiveserver2 session

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0
    • HiveServer2
    • None
    • Hide
      The description for the newly added parameter, hive.server2.logging.level should go into beeline wiki https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients under a new section describing beeline logging. It should also be described under https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.logging.operation.verbose . Also, hive.server2.logging.operation.verbose will be no longer available, hence it should be marked as not used anymore in beeline wiki.
      Show
      The description for the newly added parameter, hive.server2.logging.level should go into beeline wiki https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients under a new section describing beeline logging. It should also be described under https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.logging.operation.verbose . Also, hive.server2.logging.operation.verbose will be no longer available, hence it should be marked as not used anymore in beeline wiki.

    Description

      We need to be able to set logging per HS2 session.
      The client often uses the map-reduce completion matrix (Execution) that shows up in Beeline to debug performance. User might not want the verbose log view all the time since it obfuscates the Execution information. Hence the client should be able to change the verbosity level.
      Also, there are 2 levels of verbosity at HS2 logging and not 3. The users might want Execution + Performance counters only - so that level needs to be added.
      So for logs, the user should be able to set 3 levels of verbosity in the session, that will override the default verbosity specified in the hive-site.xml file.
      0. None - IGNORE
      1. Execution - Just shows the map-reduce tasks completing
      2. Performance - Execution + Performance counters dumped at the end
      3. Verbose - All logs

      Attachments

        1. HIVE-10119.1.patch
          18 kB
          Hari Sankar Sivarama Subramaniyan
        2. HIVE-10119.2.patch
          27 kB
          Hari Sankar Sivarama Subramaniyan
        3. HIVE-10119.3.patch
          27 kB
          Hari Sankar Sivarama Subramaniyan
        4. HIVE-10119.4.patch
          44 kB
          Hari Sankar Sivarama Subramaniyan

        Issue Links

          Activity

            People

              hsubramaniyan Hari Sankar Sivarama Subramaniyan
              hsubramaniyan Hari Sankar Sivarama Subramaniyan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: