Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5771

Constant propagation optimizer for Hive

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • Query Processor
    • None

    Description

      Currently there is no constant folding/propagation optimizer, all expressions are evaluated at runtime.

      HIVE-2470 did a great job on evaluating constants on UDF initializing phase, however, it is still a runtime evaluation and it doesn't propagate constants from a subquery to outside.

      It may reduce I/O and accelerate process if we introduce such an optimizer.

      Attachments

        1. HIVE-5771.1.patch
          3.00 MB
          Ted Xu
        2. HIVE-5771.10.patch
          716 kB
          Ashutosh Chauhan
        3. HIVE-5771.11.patch
          655 kB
          Ted Xu
        4. HIVE-5771.12.patch
          674 kB
          Ashutosh Chauhan
        5. HIVE-5771.14.patch
          596 kB
          Ted Xu
        6. HIVE-5771.16.patch
          619 kB
          Ashutosh Chauhan
        7. HIVE-5771.17.patch
          745 kB
          Ashutosh Chauhan
        8. HIVE-5771.2.patch
          2.98 MB
          Ted Xu
        9. HIVE-5771.3.patch
          2.64 MB
          Ted Xu
        10. HIVE-5771.4.patch
          2.64 MB
          Ted Xu
        11. HIVE-5771.5.patch
          2.42 MB
          Ted Xu
        12. HIVE-5771.6.patch
          2.43 MB
          Ted Xu
        13. HIVE-5771.7.patch
          567 kB
          Ashutosh Chauhan
        14. HIVE-5771.8.patch
          677 kB
          Ashutosh Chauhan
        15. HIVE-5771.9.patch
          680 kB
          Ashutosh Chauhan
        16. HIVE-5771.patch
          323 kB
          Ted Xu
        17. HIVE-5771.patch.javaonly
          61 kB
          Ted Xu

        Issue Links

        breaks

        Bug - A problem which impairs or prevents the functions of the product. HIVE-9025 join38.q (without map join) produces incorrect result when testing with multiple reducers

        • Blocker - Blocks development and/or testing work, production could not run
        • Closed
        is blocked by

        Bug - A problem which impairs or prevents the functions of the product. HIVE-7082 Vectorized parquet reader should create assigners only for the columns it assigns, not for scratch columns

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed
        relates to

        Task - A task that needs to be done. HIVE-7524 Enable auto conversion of SMBjoin in presence of constant propagate optimization

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tedxu Ted Xu Assign to me
            tedxu Ted Xu
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment