Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22925

Implement TopNKeyFilter efficiency check

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Hive
    • Labels:
      None
    • Target Version/s:

      Description

      In certain cases the TopNKey filter might work in an inefficient way and adds extra CPU overhead. For example if the rows are coming in an descending order but the filter wants the top N smallest elements the filter will forward everything.

      Inefficient should be detected in runtime so that the filter can be disabled of the ration between forwarder_rows/total_rows is too high.

        Attachments

        1. HIVE-22925.1.patch
          23 kB
          Attila Magyar
        2. HIVE-22925.2.patch
          27 kB
          Attila Magyar
        3. HIVE-22925.3.patch
          23 kB
          Attila Magyar

          Issue Links

            Activity

              People

              • Assignee:
                amagyar Attila Magyar
                Reporter:
                amagyar Attila Magyar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: