Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3841

Sampling in previous MR for range partitioning of next RS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • Query Processor
    • None

    Description

      Currently hive enforces single reducer for order by clause, which can be performance bottleneck.

      If sampling could be done on ordering key at previous MR stage, multiple reducers could be assigned for it.

      Attachments

        1. HIVE-3841.D7671.1.patch
          33 kB
          Phabricator

        Issue Links

          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. HIVE-1402 Add parallel ORDER BY to Hive

          • Major - Major loss of function.
          • Closed

          Activity

            People

              navis Navis Ryu
              navis Navis Ryu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: