Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17775

PTF should take advantage of partitioning, bucketing and sorting

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      If a PTF partitions-by a partition column of the table (or a bucketing column, although that could be more difficult), or orders-by a partition column or a column on which the table is already sorted being bucketed+sorted, it should take advantage of these properties of the table.
      That can turn some PTF operators (that I'm presently observing on a real query from a user) into a single scan, or at least a much simpler DAG; as it is, the query is very slow.

      Attachments

        Activity

          People

            Unassigned Unassigned
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: