Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7406 Vectorize Reduce-Side
  3. HIVE-7518

Output vectorized GROUP BY aggregate fields from STRUCTs for AVG, etc as columns so downstream reduce can be vectorized

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • None
    • None
    • None
    • None

    Description

      Today, aggregates like AVG are output from VectorGroupByOperator as a STRUCT. This prevents downstream operators in map, reduce shuffle, and reduce from being vectorized.

      Take the STRUCT fields used for AVG (for example) and output them (vector) columns.

      NOTE: downstream VectorGroupByOperator needs to accept column form…
      • That is, (reduce) merge of partial aggregates is different than map.

      Attachments

        Activity

          People

            mmccline Matt McCline
            mmccline Matt McCline
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: