Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-757

Don't send constants from mapper to reducer for Group By queries

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      If an aggregation function takes a constant expression, we are still sending it from mapper to reducer, but it's not necessary since we can compute the constants on the reducer side.

      This will be useful for some UDAF that have configuration parameters:

      SELECT pageid, logistic_regression("-t 1.0 -b 2.0", col1, col2, col3) FROM mytable GROUP BY pageid;
      

      Attachments

        Issue Links

          Activity

            People

              zshao Zheng Shao
              zshao Zheng Shao
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: