Log in
Skip to main content
Skip to sidebar
Linked Applications
Loading…
Dashboards
Projects
Issues
Help
Jira Core help
Keyboard Shortcuts
About Jira
Jira Credits
Log In
Spark
SPARK-25603
Generalize Nested Column Pruning
Log In
Export
XML
Word
Printable
JSON
Details
Type:
New Feature
Status:
In Progress
Priority:
Major
Resolution:
Unresolved
Affects Version/s:
3.0.0
Fix Version/s:
None
Component/s:
SQL
Labels:
None
Attachments
Issue Links
links to
GitHub Pull Request #23542
Sub-Tasks
Options
Show All
Show Open
Bulk operation
Open issue navigator
1.
Accessing nested fields with different cases in case insensitive mode
Resolved
DB Tsai
2.
Refactor `ColumnPruning` from `Optimizer.scala` to `ColumnPruning.scala`
Resolved
DB Tsai
3.
Prune the unused serializers from `SerializeFromObject`
Resolved
L. C. Hsieh
4.
Pruning nested fields from object serializers
Resolved
L. C. Hsieh
5.
Add NestedSchemaPruningBenchmark
Resolved
Dongjoon Hyun
6.
Support nested-column pruning over limit/sample/repartition
Resolved
Dongjoon Hyun
7.
Improve CollapseProject to handle projects cross limit/repartition/sample
Resolved
Dongjoon Hyun
8.
Add ReadNestedSchemaTest for file-based data sources
Resolved
Dongjoon Hyun
9.
Add AvroReadSchemaSuite
Resolved
Dongjoon Hyun
10.
Add map_keys and map_values support in nested schema pruning
Resolved
L. C. Hsieh
11.
Pruning nested serializers from object serializers: MapType support
Resolved
L. C. Hsieh
12.
Pruning nested field in complex map key from object serializers
Resolved
L. C. Hsieh
13.
Pruning nested field in map of map key and value from object serializers
Resolved
L. C. Hsieh
14.
Update nested schema benchmark result for Orc V2
Resolved
L. C. Hsieh
15.
Nested schema pruning doesn't work for aggregation e.g. `sum`.
Resolved
L. C. Hsieh
16.
catalyst inception of lateral view explode with struct raise a Catalyst error
Resolved
Peter Toth
17.
PrquetRowConverter does not follow case sensitivity
Resolved
Tae-kyeom, Kim
18.
Enable spark.sql.optimizer.nestedSchemaPruning.enabled by default
Resolved
Unassigned
19.
Enable nested schema pruning and pruning on expressions by default
Resolved
DB Tsai
20.
Nested column pruning for other operators
Resolved
L. C. Hsieh
Activity
People
Assignee:
DB Tsai
Reporter:
DB Tsai
Votes:
0
Vote for this issue
Watchers:
9
Start watching this issue
Dates
Created:
03/Oct/18 14:10
Updated:
24/Feb/20 22:50