Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20962 CommonMergeJoinOperator cannot join on complex keys
  3. HIVE-25042

Add support for map data type in Common merge join and SMB Join

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Hive, HiveServer2
    • None

    Description

      Merge join results depends on the underlying sorter used by the mapper task as we need to judge the direction after each key comparison. So the comparison done during join has to match the way the records are sorted by the mapper. As per the sorter used by mapper task (PipelinedSorter), hash-maps with same key-value pair in different order are not equal. So the merge join also behaves the same way. But map join treats them as equal. We have to modify the pipelined sorter code to handle the map datatype. Then support has to be added in the Join code to support map types.

      Attachments

        Activity

          People

            Unassigned Unassigned
            maheshk114 mahesh kumar behera
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: