|
|
|
SPARK-31736
|
SPARK-25603
Nested column pruning for other operators
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-31116
|
SPARK-25603
PrquetRowConverter does not follow case sensitivity
|
Tae-kyeom, Kim
|
Tae-kyeom, Kim
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-30870
|
SPARK-25603
catalyst inception of lateral view explode with struct raise a Catalyst error
|
Peter Toth
|
Thomas Prelle
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-29805
|
SPARK-25603
Enable nested schema pruning and pruning on expressions by default
|
DB Tsai
|
DB Tsai
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27644
|
SPARK-25603
Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default
|
Unassigned
|
Dongjoon Hyun
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
SPARK-27502
|
SPARK-25603
Update nested schema benchmark result for Orc V2
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27329
|
SPARK-25603
Pruning nested field in map of map key and value from object serializers
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27288
|
SPARK-25603
Pruning nested field in complex map key from object serializers
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27268
|
SPARK-25603
Add map_keys and map_values support in nested schema pruning
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27217
|
SPARK-25603
Nested schema pruning doesn't work for aggregation e.g. `sum`.
|
L. C. Hsieh
|
colin fang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27197
|
SPARK-25603
Add ReadNestedSchemaTest for file-based data sources
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27195
|
SPARK-25603
Add AvroReadSchemaSuite
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-27123
|
SPARK-25603
Improve CollapseProject to handle projects cross limit/repartition/sample
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26975
|
SPARK-25603
Support nested-column pruning over limit/sample/repartition
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26958
|
SPARK-25603
Add NestedSchemaPruningBenchmark
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26847
|
SPARK-25603
Pruning nested serializers from object serializers: MapType support
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26837
|
SPARK-25603
Pruning nested fields from object serializers
|
L. C. Hsieh
|
L. C. Hsieh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26619
|
SPARK-25603
Prune the unused serializers from `SerializeFromObject`
|
L. C. Hsieh
|
DB Tsai
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-26416
|
SPARK-25603
Refactor `ColumnPruning` from `Optimizer.scala` to `ColumnPruning.scala`
|
DB Tsai
|
DB Tsai
|
|
Resolved |
Won't Do
|
|
|
|
|
|
|
|
SPARK-26402
|
SPARK-25603
Accessing nested fields with different cases in case insensitive mode
|
DB Tsai
|
DB Tsai
|
|
Resolved |
Fixed
|
|
|
|
|