Apache Drill
  1. Apache Drill
  2. DRILL-776

Support selection vector sv2 and sv4 in partition sender

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.4.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, Partition sender does not accept sv2 or sv4. If the incoming batch is sv2 or sv4, a SelectionVectorRemover (SVR) op is required to remove sv2 or sv4. SVR is essentially doing copy, while partition sender is doing copy as well. This would introduce unnecessary copy to the whole query process.

      In stead, we should enhance Partition sender so that it could take sv2 and sv4 directly, removing the SVR's copy overhead. This would improve the query performance in terms of cpu and memory consumption.

        Activity

        Hide
        Jacques Nadeau added a comment -

        e9ac37d

        Show
        Jacques Nadeau added a comment - e9ac37d

          People

          • Assignee:
            Jinfeng Ni
            Reporter:
            Jinfeng Ni
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development