Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-22925

Implement TopNKeyFilter efficiency check

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      In certain cases the TopNKey filter might work in an inefficient way and adds extra CPU overhead. For example if the rows are coming in an descending order but the filter wants the top N smallest elements the filter will forward everything.

      Inefficient should be detected in runtime so that the filter can be disabled of the ration between forwarder_rows/total_rows is too high.

      Attachments

        1. HIVE-22925.1.patch
          23 kB
          Attila Magyar
        2. HIVE-22925.2.patch
          27 kB
          Attila Magyar
        3. HIVE-22925.3.patch
          23 kB
          Attila Magyar

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-17896 TopNKey: Create a standalone vectorizable TopNKey operator

          • Major - Major loss of function.
          • Closed
          links to

          Web Link ReviewBoard

          Activity

            People

              amagyar Attila Magyar
              amagyar Attila Magyar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: