Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-948

more query plan optimization rules

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11.0
    • None
    • None

    Description

      Many query plans are not optimal in that they contain redundant operators. Some examples are unnecessary select operators (select followed by select, select output being the same as input etc.). Even though these operators are not very expensive, they could account for around 10% of CPU time in some simple queries. It seems they are low-hanging fruits that we should pick first.

      BTW, it seems these optimization rules should be added at the last stage of the physical optimization phase since some redundant operators are added to facilitate physical plan generation.

      Attachments

        1. HIVE-948.D8463.1.patch
          291 kB
          Phabricator
        2. HIVE-948.D8463.2.patch
          293 kB
          Phabricator
        3. HIVE-948.D8463.3.patch
          9 kB
          Phabricator
        4. HIVE-948.D8463.3.patch
          1.28 MB
          Navis Ryu
        5. HIVE-948.D8463.4.patch
          15 kB
          Phabricator
        6. HIVE-948.D8463.5.patch
          21 kB
          Phabricator
        7. HIVE-948.testresult_only.1.txt
          1.32 MB
          Navis Ryu

        Activity

          People

            navis Navis Ryu
            nzhang Ning Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: