|
|
|
SPARK-32660
|
SPARK-24768
Show Avro related API in documentation
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-28698
|
SPARK-24768
Allow user-specified output schema in function `to_avro`
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26765
|
SPARK-24768
Avro: Validate input and output schema
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25965
|
SPARK-24768
Add read benchmark for Avro
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25883
|
SPARK-24768
Override method `prettyName` in `from_avro`/`to_avro`
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25819
|
SPARK-24768
Support parse mode option for function `from_avro`
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25718
|
SPARK-24768
Detect recursive reference in Avro schema and throw exception
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25160
|
SPARK-24768
Remove sql configuration spark.sql.avro.outputTimestampType
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25133
|
SPARK-24768
Documentaion: AVRO data source guide
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25129
|
SPARK-24768
Make the mapping of com.databricks.spark.avro to built-in module configurable
|
Unassigned
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25104
|
SPARK-24768
Validate user specified output schema
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25099
|
SPARK-24768
Generate Avro Binary files in test suite
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25002
|
SPARK-24768
Avro: revise the output record namespace
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24967
|
SPARK-24768
Use internal.Logging instead for logging
|
Hyukjin Kwon
|
Hyukjin Kwon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24924
|
SPARK-24768
Add mapping for built-in Avro data source
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24887
|
SPARK-24768
Use SerializableConfiguration in Spark util
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24883
|
SPARK-24768
Remove implicit class AvroDataFrameWriter/AvroDataFrameReader
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24881
|
SPARK-24768
New options - compression and compressionLevel
|
Max Gekk
|
Max Gekk
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24876
|
SPARK-24768
Simplify schema serialization
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24854
|
SPARK-24768
Gather all options into AvroOptions
|
Max Gekk
|
Max Gekk
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24836
|
SPARK-24768
New option - ignoreExtension
|
Max Gekk
|
Max Gekk
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24811
|
SPARK-24768
Add function `from_avro` and `to_avro`
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24810
|
SPARK-24768
Fix paths to resource files in AvroSuite
|
Max Gekk
|
Max Gekk
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24805
|
SPARK-24768
Don't ignore files without .avro extension by default
|
Max Gekk
|
Max Gekk
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24800
|
SPARK-24768
Refactor Avro Serializer and Deserializer
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24792
|
SPARK-24768
Add API `.avro` in DataFrameReader/DataFrameWriter
|
Unassigned
|
Gengliang Wang
|
|
Resolved |
Won't Fix
|
|
|
|
|
|
|
|
SPARK-24777
|
SPARK-24768
Add write benchmark for AVRO
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24776
|
SPARK-24768
AVRO unit test: use SQLTestUtils and Replace deprecated methods
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24775
|
SPARK-24768
support reading AVRO logical types - Duration
|
Unassigned
|
Gengliang Wang
|
|
Resolved |
Won't Fix
|
|
|
|
|
|
|
|
SPARK-24774
|
SPARK-24768
support reading AVRO logical types - Decimal
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24773
|
SPARK-24768
support reading AVRO logical types - Timestamp with different precisions
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24772
|
SPARK-24768
support reading AVRO logical types - Date
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24771
|
SPARK-24768
Upgrade AVRO version from 1.7.7 to 1.8.2
|
Gengliang Wang
|
Gengliang Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-24770
|
SPARK-24768
Supporting to convert a column into binary of AVRO format
|
Unassigned
|
Gengliang Wang
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
SPARK-24769
|
SPARK-24768
Support for parsing AVRO binary column
|
Unassigned
|
Gengliang Wang
|
|
Resolved |
Duplicate
|
|
|
|
|