Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.6.0
-
None
Description
The parquet-avro object model currently only uses String for binary/utf8 data. It should use Utf8, which doesn't copy data and require 2x the space whenever Avro would. That is by default in generic, unless avro.java.string is set to "string". Avro reflect always uses String, and both reflect and specific will respect the java-class property for stringable types.
Attachments
Issue Links
- blocks
-
PARQUET-292 Release Parquet 1.8.0
- Resolved
- depends upon
-
PARQUET-243 Add avro-reflect support
- Resolved
- links to