Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5771

Constant propagation optimizer for Hive

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • Query Processor
    • None

    Description

      Currently there is no constant folding/propagation optimizer, all expressions are evaluated at runtime.

      HIVE-2470 did a great job on evaluating constants on UDF initializing phase, however, it is still a runtime evaluation and it doesn't propagate constants from a subquery to outside.

      It may reduce I/O and accelerate process if we introduce such an optimizer.

      Attachments

        1. HIVE-5771.1.patch
          3.00 MB
          Ted Xu
        2. HIVE-5771.10.patch
          716 kB
          Ashutosh Chauhan
        3. HIVE-5771.11.patch
          655 kB
          Ted Xu
        4. HIVE-5771.12.patch
          674 kB
          Ashutosh Chauhan
        5. HIVE-5771.14.patch
          596 kB
          Ted Xu
        6. HIVE-5771.16.patch
          619 kB
          Ashutosh Chauhan
        7. HIVE-5771.17.patch
          745 kB
          Ashutosh Chauhan
        8. HIVE-5771.2.patch
          2.98 MB
          Ted Xu
        9. HIVE-5771.3.patch
          2.64 MB
          Ted Xu
        10. HIVE-5771.4.patch
          2.64 MB
          Ted Xu
        11. HIVE-5771.5.patch
          2.42 MB
          Ted Xu
        12. HIVE-5771.6.patch
          2.43 MB
          Ted Xu
        13. HIVE-5771.7.patch
          567 kB
          Ashutosh Chauhan
        14. HIVE-5771.8.patch
          677 kB
          Ashutosh Chauhan
        15. HIVE-5771.9.patch
          680 kB
          Ashutosh Chauhan
        16. HIVE-5771.patch
          323 kB
          Ted Xu
        17. HIVE-5771.patch.javaonly
          61 kB
          Ted Xu

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-9025 join38.q (without map join) produces incorrect result when testing with multiple reducers

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-7082 Vectorized parquet reader should create assigners only for the columns it assigns, not for scratch columns

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Task - A task that needs to be done. HIVE-7524 Enable auto conversion of SMBjoin in presence of constant propagate optimization

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tedxu Ted Xu
              tedxu Ted Xu
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: