|
|
|
SPARK-30269
|
SPARK-16026
Should use old partition stats to decide whether to update stats when analyzing partition
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-25185
|
SPARK-16026
CBO rowcount statistics doesn't work for partitioned parquet external table
|
Unassigned
|
Amit
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-22892
|
SPARK-16026
Simplify some estimation logic by using double instead of decimal
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-22626
|
SPARK-16026
Wrong Hive table statistics may trigger OOM if enables CBO
|
Yuming Wang
|
Yuming Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-22529
|
SPARK-16026
Relation stats should be consistent with other plans based on cbo config
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-22515
|
SPARK-16026
Estimation relation size based on numRows * rowSize
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21324
|
SPARK-16026
Improve statistics test suites
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21237
|
SPARK-16026
Invalidate stats once table data is changed
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21180
|
SPARK-16026
Remove conf from stats functions since now we have conf in LogicalPlan
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21127
|
SPARK-16026
Update statistics after data changing commands
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21083
|
SPARK-16026
Store zero size and row count after analyzing empty table
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-21031
|
SPARK-16026
Add `alterTableStats` to store spark's stats and let `alterTable` keep existing stats
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20881
|
SPARK-16026
Clearly document the mechanism to choose between two sources of statistics
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20678
|
SPARK-16026
Ndv for columns not in filter condition should also be updated
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20366
|
SPARK-16026
Fix recursive join reordering: inside joins are not reordered
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20318
|
SPARK-16026
Use Catalyst type for min/max in ColumnStat for ease of estimation
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20186
|
SPARK-16026
BroadcastHint should use child's stats
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20124
|
SPARK-16026
Join reorder should keep the same order of final project attributes
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-20104
|
SPARK-16026
Don't estimate IsNull or IsNotNull predicates for non-leaf node
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19915
|
SPARK-16026
Improve join reorder: Exclude cartesian product candidates to reduce the search space
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19408
|
SPARK-16026
cardinality estimation involving two columns of the same table
|
Ron Hu
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19350
|
SPARK-16026
Cardinality estimation of Limit and Sample
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19271
|
SPARK-16026
Change non-cbo estimation of aggregate
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19149
|
SPARK-16026
Unify two sets of statistics in LogicalPlan
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19132
|
SPARK-16026
Add test cases for row size estimation
|
Zhenhua Wang
|
Reynold Xin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-19020
|
SPARK-16026
Cardinality estimation of aggregate operator
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18998
|
SPARK-16026
Add a cbo conf to switch between default statistics and cbo estimated statistics
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18911
|
SPARK-16026
Decouple Statistics and CatalogTable
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18815
|
SPARK-16026
NPE when collecting column stats for string/binary column having only null values
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18663
|
SPARK-16026
Simplify CountMinSketch aggregate implementation
|
Reynold Xin
|
Reynold Xin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18522
|
SPARK-16026
Create explicit contract for column stats serialization
|
Reynold Xin
|
Reynold Xin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18505
|
SPARK-16026
Simplify AnalyzeColumnCommand
|
Reynold Xin
|
Reynold Xin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18429
|
SPARK-16026
SQL aggregate function for CountMinSketch
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-18149
|
SPARK-16026
build side decision based on cbo
|
Unassigned
|
Zhenhua Wang
|
|
Closed |
Implemented
|
|
|
|
|
|
|
|
SPARK-18000
|
SPARK-16026
Aggregation function for computing bins (distinct value, count) pairs for equi-width histograms
|
Unassigned
|
Zhenhua Wang
|
|
Closed |
Won't Fix
|
|
|
|
|
|
|
|
SPARK-17827
|
SPARK-16026
StatisticsColumnSuite failures on big endian platforms
|
Peter George Robbins
|
Peter George Robbins
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17642
|
SPARK-16026
Support DESC FORMATTED TABLE COLUMN command to show column-level statistics
|
Zhenhua Wang
|
Zhenhua Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17282
|
SPARK-16026
Implement ALTER TABLE UPDATE STATISTICS SET
|
Unassigned
|
Xiao Li
|
|
Closed |
Won't Fix
|
|
|
|
|
|
|
|
SPARK-17080
|
SPARK-16026
join reorder
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17079
|
SPARK-16026
broadcast decision based on cbo
|
Unassigned
|
Ron Hu
|
|
Closed |
Implemented
|
|
|
|
|
|
|
|
SPARK-17078
|
SPARK-16026
show estimated stats when doing explain
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17077
|
SPARK-16026
Cardinality estimation of project operator
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17076
|
SPARK-16026
Cardinality estimation of join operator
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17075
|
SPARK-16026
Cardinality Estimation of Predicate Expressions
|
Ron Hu
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17073
|
SPARK-16026
generate basic stats for column
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-17072
|
SPARK-16026
generate table level stats:stats generation/storing/loading
|
Zhenhua Wang
|
Ron Hu
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-16990
|
SPARK-16026
Define the data structure to hold the statistics for CBO
|
Unassigned
|
Ron Hu
|
|
Closed |
Duplicate
|
|
|
|
|