Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Release Note:
      Map join hint will no longer be valid for some queries. Drop the hint in those cases. Hive will automatically try to convert join to map-join with config hive.auto.convert.join set to true.

      Description

      hive.auto.convert.join has been around for a long time, and is pretty stable.
      When mapjoin hint was created, the above parameter did not exist.

      The only reason for the user to specify a mapjoin currently is if they want
      it to be converted to a bucketed-mapjoin or a sort-merge bucketed mapjoin.
      Eventually, that should also go away, but that may take some time to stabilize.

      There are many rules in SemanticAnalyzer to handle the following trees:

      ReduceSink -> MapJoin
      Union -> MapJoin
      MapJoin -> MapJoin

      This should not be supported anymore. In any of the above scenarios, the
      user can get the mapjoin behavior by setting hive.auto.convert.join to true
      and not specifying the hint. This will simplify the code a lot.

      What does everyone think ?

      1. hive.3784.9.patch
        581 kB
        Namit Jain
      2. hive.3784.8.patch
        578 kB
        Namit Jain
      3. hive.3784.7.patch
        571 kB
        Namit Jain
      4. hive.3784.6.patch
        528 kB
        Namit Jain
      5. hive.3784.5.patch
        650 kB
        Namit Jain
      6. hive.3784.4.patch
        650 kB
        Namit Jain
      7. hive.3784.3.patch
        434 kB
        Namit Jain
      8. hive.3784.22.patch
        665 kB
        Namit Jain
      9. hive.3784.21.patch
        659 kB
        Namit Jain
      10. hive.3784.2.patch
        209 kB
        Namit Jain
      11. hive.3784.19.patch
        659 kB
        Namit Jain
      12. hive.3784.18.patch
        659 kB
        Namit Jain
      13. hive.3784.17.patch
        659 kB
        Namit Jain
      14. hive.3784.16.patch
        658 kB
        Namit Jain
      15. hive.3784.15.patch
        657 kB
        Namit Jain
      16. hive.3784.14.patch
        617 kB
        Namit Jain
      17. hive.3784.13.patch
        617 kB
        Namit Jain
      18. hive.3784.12.patch
        550 kB
        Namit Jain
      19. hive.3784.11.patch
        547 kB
        Namit Jain
      20. hive.3784.10.patch
        504 kB
        Namit Jain
      21. hive.3784.1.patch
        209 kB
        Namit Jain

        Issue Links

          Activity

          Namit Jain created issue -
          Namit Jain made changes -
          Field Original Value New Value
          Attachment hive.3784.1.patch [ 12560545 ]
          Namit Jain made changes -
          Attachment hive.3784.2.patch [ 12560549 ]
          Namit Jain made changes -
          Attachment hive.3784.3.patch [ 12560724 ]
          Namit Jain made changes -
          Attachment hive.3784.4.patch [ 12560735 ]
          Namit Jain made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Namit Jain made changes -
          Attachment hive.3784.5.patch [ 12560918 ]
          Amareshwari Sriramadasu made changes -
          Link This issue duplicates HIVE-1695 [ HIVE-1695 ]
          Namit Jain made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Namit Jain made changes -
          Attachment hive.3784.6.patch [ 12565906 ]
          Namit Jain made changes -
          Attachment hive.3784.7.patch [ 12566143 ]
          Namit Jain made changes -
          Attachment hive.3784.8.patch [ 12566257 ]
          Namit Jain made changes -
          Attachment hive.3784.9.patch [ 12566276 ]
          Namit Jain made changes -
          Attachment hive.3784.10.patch [ 12566292 ]
          Namit Jain made changes -
          Attachment hive.3784.11.patch [ 12566326 ]
          Namit Jain made changes -
          Attachment hive.3784.12.patch [ 12566457 ]
          Namit Jain made changes -
          Link This issue is related to HIVE-3403 [ HIVE-3403 ]
          Namit Jain made changes -
          Link This issue is related to HIVE-3633 [ HIVE-3633 ]
          Namit Jain made changes -
          Attachment hive.3784.13.patch [ 12566459 ]
          Namit Jain made changes -
          Attachment hive.3784.14.patch [ 12566461 ]
          Namit Jain made changes -
          Attachment hive.3784.15.patch [ 12566465 ]
          Namit Jain made changes -
          Attachment hive.3784.16.patch [ 12566507 ]
          Namit Jain made changes -
          Link This issue relates to HIVE-3403 [ HIVE-3403 ]
          Namit Jain made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Namit Jain made changes -
          Attachment hive.3784.17.patch [ 12566678 ]
          Namit Jain made changes -
          Attachment hive.3784.18.patch [ 12566679 ]
          Namit Jain made changes -
          Attachment hive.3784.19.patch [ 12566680 ]
          Namit Jain made changes -
          Link This issue blocks HIVE-3952 [ HIVE-3952 ]
          Namit Jain made changes -
          Attachment hive.3784.21.patch [ 12566788 ]
          Namit Jain made changes -
          Attachment hive.3784.22.patch [ 12566902 ]
          Ashutosh Chauhan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note Map join hint will no longer be valid for some queries. Drop the hint in those cases. Hive will automatically try to convert join to map-join with config hive.auto.convert.join set to true.
          Fix Version/s 0.11.0 [ 12323587 ]
          Resolution Fixed [ 1 ]
          Vikram Dixit K made changes -
          Link This issue is duplicated by HIVE-3652 [ HIVE-3652 ]
          Amareshwari Sriramadasu made changes -
          Link This issue duplicates HIVE-3652 [ HIVE-3652 ]
          Namit Jain made changes -
          Link This issue blocks HIVE-4042 [ HIVE-4042 ]
          Navis made changes -
          Link This issue relates to HIVE-3326 [ HIVE-3326 ]
          Gavin made changes -
          Link This issue blocks HIVE-3952 [ HIVE-3952 ]
          Gavin made changes -
          Link This issue is depended upon by HIVE-3952 [ HIVE-3952 ]
          Gavin made changes -
          Link This issue blocks HIVE-4042 [ HIVE-4042 ]
          Gavin made changes -
          Link This issue is depended upon by HIVE-4042 [ HIVE-4042 ]
          Owen O'Malley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Namit Jain
              Reporter:
              Namit Jain
            • Votes:
              1 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development