Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-286

Avro object model should use Utf8

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.8.0
    • Component/s: parquet-avro
    • Labels:
      None

      Description

      The parquet-avro object model currently only uses String for binary/utf8 data. It should use Utf8, which doesn't copy data and require 2x the space whenever Avro would. That is by default in generic, unless avro.java.string is set to "string". Avro reflect always uses String, and both reflect and specific will respect the java-class property for stringable types.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rdblue Ryan Blue
                Reporter:
                rdblue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: