Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3972

Vectorize Parquet Writer

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Storage - Parquet

    Description

      Currently the ParquetRecordWriter receives one record at a time and then turns that into columns.
      Which means we convert from Drill columns to rows and then to Parquet columns.
      Instead we could directly convert the Drill columns into Parquet columns in a vectorized manner.

      Attachments

        Activity

          People

            andrew.musselman Andrew Musselman
            julienledem Julien Le Dem
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: