Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21304

Make bucketing version usage more robust

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • None
    • None

    Description

      • Show Bucketing version for ReduceSinkOp in explain extended plan - this helps identify what hashing algorithm is being used by by ReduceSinkOp.
      • move the actually selected version to the "conf" so that it doesn't get lost
      • replace trait related logic with a separate optimizer rule
      • do version selection based on a group of operator - this is more reliable
      • skip bucketingversion selection for tables with 1 buckets
      • prefer to use version 2 if possible
      • fix operator creations which didn't set a new conf

      Attachments

        1. HIVE-21304.01.patch
          12 kB
          Zoltan Haindrich
        2. HIVE-21304.02.patch
          608 kB
          Zoltan Haindrich
        3. HIVE-21304.03.patch
          608 kB
          Zoltan Haindrich
        4. HIVE-21304.04.patch
          615 kB
          Zoltan Haindrich
        5. HIVE-21304.05.patch
          617 kB
          Zoltan Haindrich
        6. HIVE-21304.06.patch
          630 kB
          Zoltan Haindrich
        7. HIVE-21304.07.patch
          632 kB
          Zoltan Haindrich
        8. HIVE-21304.08.patch
          623 kB
          Zoltan Haindrich
        9. HIVE-21304.09.patch
          623 kB
          Zoltan Haindrich
        10. HIVE-21304.10.patch
          623 kB
          Zoltan Haindrich
        11. HIVE-21304.11.patch
          627 kB
          Zoltan Haindrich
        12. HIVE-21304.12.patch
          664 kB
          Zoltan Haindrich
        13. HIVE-21304.13.patch
          664 kB
          Zoltan Haindrich
        14. HIVE-21304.14.patch
          664 kB
          Zoltan Haindrich
        15. HIVE-21304.15.patch
          664 kB
          Zoltan Haindrich
        16. HIVE-21304.16.patch
          664 kB
          Zoltan Haindrich
        17. HIVE-21304.17.patch
          664 kB
          Zoltan Haindrich
        18. HIVE-21304.18.patch
          669 kB
          Zoltan Haindrich
        19. HIVE-21304.19.patch
          731 kB
          Zoltan Haindrich
        20. HIVE-21304.20.patch
          731 kB
          Zoltan Haindrich
        21. HIVE-21304.21.patch
          809 kB
          Zoltan Haindrich
        22. HIVE-21304.22.patch
          1.26 MB
          Zoltan Haindrich
        23. HIVE-21304.23.patch
          1.51 MB
          Zoltan Haindrich
        24. HIVE-21304.24.patch
          1.51 MB
          Zoltan Haindrich
        25. HIVE-21304.25.patch
          1.76 MB
          Zoltan Haindrich
        26. HIVE-21304.26.patch
          1.92 MB
          Zoltan Haindrich
        27. HIVE-21304.27.patch
          1.92 MB
          Zoltan Haindrich
        28. HIVE-21304.28.patch
          1.95 MB
          Zoltan Haindrich
        29. HIVE-21304.29.patch
          2.03 MB
          Zoltan Haindrich
        30. HIVE-21304.30.patch
          1.65 MB
          Zoltan Haindrich
        31. HIVE-21304.31.patch
          1.65 MB
          Zoltan Haindrich
        32. HIVE-21304.32.patch
          1.65 MB
          Zoltan Haindrich
        33. HIVE-21304.33.patch
          1.65 MB
          Zoltan Haindrich
        34. HIVE-21304.33.patch
          1.65 MB
          Zoltan Haindrich
        35. HIVE-21304.33.patch
          1.65 MB
          Zoltan Haindrich
        36. HIVE-21304.34.patch
          1.65 MB
          Zoltan Haindrich
        37. HIVE-21304.34.patch
          1.65 MB
          Zoltan Haindrich
        38. HIVE-21304.35.patch
          1.65 MB
          Zoltan Haindrich
        39. HIVE-21304.35.patch
          1.65 MB
          Zoltan Haindrich
        40. HIVE-21304.36.patch
          1.65 MB
          Zoltan Haindrich
        41. HIVE-21304.37.patch
          1.96 MB
          Zoltan Haindrich
        42. HIVE-21304.38.patch
          1.63 MB
          Zoltan Haindrich
        43. HIVE-21304.38.patch
          1.63 MB
          Zoltan Haindrich
        44. HIVE-21304.38.patch
          1.63 MB
          Zoltan Haindrich
        45. HIVE-21304.39.patch
          1.63 MB
          Zoltan Haindrich
        46. HIVE-21304.40.patch
          1.63 MB
          Zoltan Haindrich

        Issue Links

          fixes

          Bug - A problem which impairs or prevents the functions of the product. HIVE-22098 Data loss occurs when multiple tables are join with different bucket_version

          • Blocker - Blocks development and/or testing work, production could not run
          • Patch Available

          Bug - A problem which impairs or prevents the functions of the product. HIVE-23809 Data loss occurs when using tez engine to join different bucketing_version tables

          • Major - Major loss of function.
          • Patch Available
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-23809 Data loss occurs when using tez engine to join different bucketing_version tables

          • Major - Major loss of function.
          • Patch Available
          links to

          Web Link pr994

          Activity

            People

              kgyrtkirk Zoltan Haindrich
              djaiswal Deepak Jaiswal
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 50m
                  50m