Apache Drill
  1. Apache Drill
  2. DRILL-1307

Implement support for Fixed Binary type in parquet reader

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.7.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently we can red out of a fixed binary column in parquet only if it is one of the decimal converted types. This is only a subset of the use cases of the fixed binary table as it can be used to store any arbitrary binary data that is byte aligned and the same length for all values. Unfortunately we do not have the fixed binary vector implemented in Drill currently, so the data will be read into the varbinary vectors, but this cam be optimized later.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        88d 2h 3m 1 Mehant Baid 12/Nov/14 02:11
        Tony Stevenson made changes -
        Workflow no-reopen-closed, patch-avail, testing [ 12883163 ] Drill workflow [ 12934819 ]
        Mehant Baid made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Mehant Baid added a comment -

        Fixed in c1fcb6528cf1d037df91d54629f2c71902cb25cc

        Show
        Mehant Baid added a comment - Fixed in c1fcb6528cf1d037df91d54629f2c71902cb25cc
        Jacques Nadeau made changes -
        Fix Version/s 0.7.0 [ 12327473 ]
        Fix Version/s 0.6.0 [ 12327472 ]
        Jason Altekruse made changes -
        Hide
        Jason Altekruse added a comment -

        this is a patch that closes a few issues, see the commit message for details

        Show
        Jason Altekruse added a comment - this is a patch that closes a few issues, see the commit message for details
        Jason Altekruse made changes -
        Assignee Jason Altekruse [ jaltekruse ]
        Jacques Nadeau made changes -
        Fix Version/s 0.6.0 [ 12327472 ]
        Fix Version/s 0.5.0 [ 12324880 ]
        Jason Altekruse made changes -
        Summary Implement support for FixedBinary type in parquet reader Implement support for Fixed Binary type in parquet reader
        Jacques Nadeau made changes -
        Fix Version/s 0.5.0 [ 12324880 ]
        Jason Altekruse made changes -
        Field Original Value New Value
        Description Currently we can red out of a fixed binary column in parquet only if it is one of the decimal converted types. This is only a subset of the use cases of the fixed binary table as it can be used to store any arbirary binary data that is byte aligned and the same length for all values. Unfortunately we do not have the fixed binary vector implemented in Drill currently, so the data will be read into the varbinary vectors, but this cam be optimized later. Currently we can red out of a fixed binary column in parquet only if it is one of the decimal converted types. This is only a subset of the use cases of the fixed binary table as it can be used to store any arbitrary binary data that is byte aligned and the same length for all values. Unfortunately we do not have the fixed binary vector implemented in Drill currently, so the data will be read into the varbinary vectors, but this cam be optimized later.
        Jason Altekruse created issue -

          People

          • Assignee:
            Jason Altekruse
            Reporter:
            Jason Altekruse
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development