Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-948

more query plan optimization rules

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11.0
    • None
    • None

    Description

      Many query plans are not optimal in that they contain redundant operators. Some examples are unnecessary select operators (select followed by select, select output being the same as input etc.). Even though these operators are not very expensive, they could account for around 10% of CPU time in some simple queries. It seems they are low-hanging fruits that we should pick first.

      BTW, it seems these optimization rules should be added at the last stage of the physical optimization phase since some redundant operators are added to facilitate physical plan generation.

      Attachments

        1. HIVE-948.testresult_only.1.txt
          1.32 MB
          Navis Ryu
        2. HIVE-948.D8463.5.patch
          21 kB
          Phabricator
        3. HIVE-948.D8463.4.patch
          15 kB
          Phabricator
        4. HIVE-948.D8463.3.patch
          9 kB
          Phabricator
        5. HIVE-948.D8463.3.patch
          1.28 MB
          Navis Ryu
        6. HIVE-948.D8463.2.patch
          293 kB
          Phabricator
        7. HIVE-948.D8463.1.patch
          291 kB
          Phabricator

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            navis Navis Ryu Assign to me
            nzhang Ning Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment