|
|
|
SPARK-49723
|
SPARK-45891
Add variant metrics to JSON Scan nodes and Project nodes containing variant-constructor expressions
|
Unassigned
|
Harsh Motwani
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-49591
|
SPARK-45891
Distinguish logical and physical types in variant spec
|
David Cashman
|
David Cashman
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-49451
|
SPARK-45891
Allow duplicate keys in parse_json.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-49449
|
SPARK-45891
Remove string and binary from metadata in spec
|
David Cashman
|
David Cashman
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-49443
|
SPARK-45891
Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-49141
|
SPARK-45891
Mark variant as hive incompatible data type
|
Kent Yao
|
Kent Yao
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-49074
|
SPARK-45891
Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48994
|
SPARK-45891
Add support for interval types in the Variant spec
|
Unassigned
|
Harsh Motwani
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-48898
|
SPARK-45891
Functions to shred a Variant into components
|
Unassigned
|
David Cashman
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-48834
|
SPARK-45891
Disable variant input/output from scalar UDFs
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48833
|
SPARK-45891
Support variant in `InMemoryTableScan`
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48587
|
SPARK-45891
Avoid storage amplification when accessing sub-Variant
|
David Cashman
|
David Cashman
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48495
|
SPARK-45891
Document planned approach to shredding
|
David Cashman
|
David Cashman
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48224
|
SPARK-45891
Disable variant from being a part of a map key
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48067
|
SPARK-45891
Fix Variant default columns for more complex default variants
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-48051
|
SPARK-45891
Add Golden Table Tests for Variant from different engines
|
Unassigned
|
Richard Chen
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-48033
|
SPARK-45891
Support Generated Column expressions that are `RuntimeReplaceable`
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47922
|
SPARK-45891
Implement try_parse_json
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47903
|
SPARK-45891
Add remaining scalar types to the Python variant library
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47890
|
SPARK-45891
Add python and scala dataframe variant expression aliases.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47867
|
SPARK-45891
Support Variant in JSON scan.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47846
|
SPARK-45891
Add support for Variant schema in from_json
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47826
|
SPARK-45891
Add VariantVal for PySpark
|
Gene Pang
|
Gene Pang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47822
|
SPARK-45891
Prohibit Hash expressions from hashing Variant type
|
Harsh Motwani
|
Harsh Motwani
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47821
|
SPARK-45891
Add is_variant_null expression
|
Richard Chen
|
Richard Chen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47803
|
SPARK-45891
Support cast to variant.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47775
|
SPARK-45891
Support remaining scalar types in the variant spec.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47769
|
SPARK-45891
Add schema_of_variant_agg expression.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47682
|
SPARK-45891
Support cast from variant.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47681
|
SPARK-45891
Add schema_of_variant expression.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47680
|
SPARK-45891
Add variant_explode expression.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47569
|
SPARK-45891
Disallow comparing variant.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47551
|
SPARK-45891
Add variant_get expression.
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47546
|
SPARK-45891
Improve parquet schema checks
|
David Cashman
|
David Cashman
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47451
|
SPARK-45891
Support to_json(variant)
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-47366
|
SPARK-45891
Implement parse_json
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-45827
|
SPARK-45891
Add Variant data type in Spark
|
Chenhao Li
|
Chenhao Li
|
|
Resolved |
Fixed
|
|
|
|
|