Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20962 CommonMergeJoinOperator cannot join on complex keys
  3. HIVE-25042

Add support for map data type in Common merge join and SMB Join

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Hive, HiveServer2
    • Labels:
      None

      Description

      Merge join results depends on the underlying sorter used by the mapper task as we need to judge the direction after each key comparison. So the comparison done during join has to match the way the records are sorted by the mapper. As per the sorter used by mapper task (PipelinedSorter), hash-maps with same key-value pair in different order are not equal. So the merge join also behaves the same way. But map join treats them as equal. We have to modify the pipelined sorter code to handle the map datatype. Then support has to be added in the Join code to support map types.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              maheshk114 mahesh kumar behera
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: