Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-10437

[C++][Dataset] Ensure virtual columns are not materialized on write

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.0.0
    • None
    • C++

    Description

      If a column is virtual on read and will remain virtual after writing then materializing and grouping on it is a pure waste. Maybe Partitioning::Partition should take a "already known" partition expression and only group on columns not in it?

      Attachments

        Activity

          People

            Unassigned Unassigned
            bkietz Ben Kietzman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: