Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24285

GlobalLimitOptimizer not working

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 2.0.1, 3.1.2
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None

      Description

      In our environment,we have set hive.limit.optimize.enable=true,hive.limit.row.max.size=10000000,hive.limit.optimize.fetch.max=1000,hive.fetch.task.conversion.threshold=256000000000000,hive.fetch.task.conversion=more,hive.auto.convert.join=true

      when we execute the sql like this,GlobalLimitOptimizer not working.

      select db_name,concat('22',cnt) from (select * from lb1 limit 5) t1;

      because in this sql there is one LimitOperator, but logs count 2

      the code and logs below

       

       

       

        Attachments

        1. image-2020-10-19-19-00-23-487.png
          3.86 MB
          lucusguo
        2. image-2020-10-19-19-00-05-123.png
          3.24 MB
          lucusguo
        3. image-2020-10-19-18-59-05-302.png
          3.86 MB
          lucusguo

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              lucusguo lucusguo
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 504h
                504h
                Remaining:
                Remaining Estimate - 504h
                504h
                Logged:
                Time Spent - Not Specified
                Not Specified