Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21399

Adjust hive.map.aggr.hash.min.reduction statically depending on group by statistics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      Currently, the value is set statically from config variable. If stats are available, we could try to adjust this value at optimization time to favor turning off hash aggregation earlier.

      Attachments

        1. HIVE-21399.01.patch
          28 kB
          jcamachorodriguez
        2. HIVE-21399.02.patch
          28 kB
          jcamachorodriguez
        3. HIVE-21399.03.patch
          29 kB
          jcamachorodriguez
        4. HIVE-21399.04.patch
          3.29 MB
          jcamachorodriguez
        5. HIVE-21399.05.patch
          3.32 MB
          jcamachorodriguez
        6. HIVE-21399.06.patch
          3.32 MB
          jcamachorodriguez
        7. HIVE-21399.07.patch
          3.28 MB
          jcamachorodriguez
        8. HIVE-21399.08.patch
          3.27 MB
          jcamachorodriguez

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-21780 SetHashGroupByMinReduction should check parent operator number of rows to compute reduction

          • Major - Major loss of function.
          • Closed

          Activity

            People

              jcamacho Jesús Camacho Rodríguez
              jcamacho Jesús Camacho Rodríguez
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: