Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-16061

When hive.async.log.enabled is set to true, some output is not printed to the beeline console

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.1.1
    • Fix Version/s: 3.0.0
    • Component/s: Logging
    • Labels:
      None

      Description

      Run a hiveserver2 instance "hive --service hiveserver2".
      Then from another console, connect to hiveserver2 "beeline -u "jdbc:hive2://localhost:10000"

      When you run a MR job like "select t1.key from src t1 join src t2 on t1.key=t2.key", some of the console logs like MR job info are not printed to the console while it just print to the hiveserver2 console.

      When hive.async.log.enabled is set to false and restarts the HiveServer2, then the output will be printed to the beeline console.

      OperationLog implementation uses the ThreadLocal variable to store associated the log file. When the hive.async.log.enabled is set to true, the logs will be processed by a ThreadPool and the actual threads from the pool which prints the message won't be able to access the log file stored in the original thread.

        Attachments

        1. HIVE-16061.4.patch
          93 kB
          Aihua Xu
        2. HIVE-16061.3.patch
          47 kB
          Aihua Xu
        3. HIVE-16061.2.patch
          2 kB
          Aihua Xu
        4. HIVE-16061.1.patch
          16 kB
          Aihua Xu

          Issue Links

            Activity

              People

              • Assignee:
                aihuaxu Aihua Xu
                Reporter:
                aihuaxu Aihua Xu
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: