Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21722

REPL:: logs are missing in hiveStatement.getQueryLog output during parallel execution mode.

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      getQueryLog only reads logs from Background thread scope. If parallel execution is set to true, a new thread is created for execution and all the logs added by the new thread are not added to the parent  Background thread scope. In replication scope, replStateLogTasks are started in parallel mode causing the logs to be skipped from getQueryLog scope. 

      There is one more issue, with the conf is not passed while creating replStateLogTask during bootstrap load end. The same issue is there with event load during incremental load. The incremental load end log task is created with the proper config. 

        Attachments

        1. HIVE-21722.01.patch
          10 kB
          mahesh kumar behera
        2. HIVE-21722.02.patch
          12 kB
          mahesh kumar behera

          Issue Links

            Activity

              People

              • Assignee:
                maheshk114 mahesh kumar behera
                Reporter:
                maheshk114 mahesh kumar behera
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h
                  3h