Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23744 Reduce query startup latency
  3. HIVE-23596

LLAP: Encode initial guaranteed task information in containerId

    XMLWordPrintableJSON

Details

    Description

      We should avoid calling LlapTaskScheduler to get initial isguaranteed flag for all the tasks. It causes arbitrary delays in sending tasks out. Since communicator is a single thread, any blocking there delays all the tasks.

      There are https://jira.apache.org/jira/browse/TEZ-4192 and https://jira.apache.org/jira/browse/HIVE-23589 for a proper solution to this. However, that requires a Tez release which seems far right now. We can replace the current hack with another hack that does not require locking.

      Attachments

        Issue Links

          Activity

            People

              mustafaiman Mustafa İman
              mustafaiman Mustafa İman
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m