Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4163

Support schema changes for MergeJoin operator.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: None
    • Labels:
      None

      Description

      Since external sort operator supports schema changes, allow use of union types in merge join to support for schema changes.

      For now, we assume that merge join always works on record batches from sort operator. Thus merging schemas and promoting to union vectors is already taken care by sort operator.

      Test Cases:
      1) Only one side changes schema (join on union type and primitive type)
      2) Both sids change schema on all columns.
      3) Join between numeric types and string types.
      4) Missing columns - each batch has different columns.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jaltekruse Jason Altekruse
                Reporter:
                aah amit hadke
                Reviewer:
                Khurram Faraaz
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: