|
|
|
SPARK-38129
|
SPARK-33828
Adaptively enable timeout for BroadcastQueryStageExec
|
Unassigned
|
weixiuli
|
|
In Progress |
Unresolved
|
|
|
|
|
|
|
|
SPARK-36666
|
SPARK-33828
[SQL] Regression in AQEShuffleReadExec
|
Andy Grove
|
Andy Grove
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-36414
|
SPARK-33828
Disable timeout for BroadcastQueryStageExec in AQE
|
Kent Yao 2
|
Kent Yao 2
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-36184
|
SPARK-33828
Use ValidateRequirements instead of EnsureRequirements to skip AQE rules that adds extra shuffles
|
Wenchen Fan
|
Wenchen Fan
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-36032
|
SPARK-33828
Use inputPlan instead of currentPhysicalPlan to initialize logical link
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35989
|
SPARK-33828
Do not remove REPARTITION_BY_NUM shuffle if AQE is enabled
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35968
|
SPARK-33828
Make sure partitions are not too small in AQE partition coalescing
|
Wenchen Fan
|
Wenchen Fan
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35888
|
SPARK-33828
Add dataSize field in CoalescedPartitionSpec
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35884
|
SPARK-33828
EXPLAIN FORMATTED for AQE
|
Wenchen Fan
|
Wenchen Fan
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35874
|
SPARK-33828
AQE Shuffle should wait for its subqueries to finish before materializing
|
Wenchen Fan
|
Wenchen Fan
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35695
|
SPARK-33828
QueryExecutionListener does not see any observed metrics fired before persist/cache
|
Tanel Kiis
|
Tanel Kiis
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35608
|
SPARK-33828
Support AQE optimizer side transformUpWithPruning
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35568
|
SPARK-33828
UnsupportedOperationException: WholeStageCodegen (3) does not implement doExecuteBroadcast
|
Ke Jia
|
Yuming Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35455
|
SPARK-33828
Enhance EliminateUnnecessaryJoin
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35282
|
SPARK-33828
Support AQE side shuffled hash join formula
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35264
|
SPARK-33828
Support AQE side broadcastJoin threshold
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35239
|
SPARK-33828
Coalesce shuffle partition should handle empty input RDD
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35214
|
SPARK-33828
OptimizeSkewedJoin support ShuffledHashJoinExec
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35168
|
SPARK-33828
mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum
|
Kent Yao 2
|
Kent Yao 2
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35133
|
SPARK-33828
EXPLAIN CODEGEN does not work with AQE
|
Cheng Su
|
Cheng Su
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-35093
|
SPARK-33828
AQE columnar mismatch on exchange reuse
|
Andy Grove
|
Andy Grove
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-34899
|
SPARK-33828
Use origin plan if can not coalesce shuffle partition
|
XiDuo You
|
XiDuo You
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-34790
|
SPARK-33828
Fail in fetch shuffle blocks in batch when i/o encryption is enabled.
|
hezuojiao
|
hezuojiao
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-34682
|
SPARK-33828
Regression in "operating on canonicalized plan" check in CustomShuffleReaderExec
|
Andy Grove
|
Andy Grove
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-34637
|
SPARK-33828
Support DPP in AQE when the broadcast exchange can be reused
|
Ke Jia
|
Ke Jia
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-34168
|
SPARK-33828
Support DPP in AQE When the join is Broadcast hash join before applying the AQE rules
|
Ke Jia
|
Ke Jia
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-33933
|
SPARK-33828
Broadcast timeout happened unexpectedly in AQE
|
Yu Zhong
|
Yu Zhong
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-33923
|
SPARK-33828
Fix some tests with AQE enabled
|
wuyi
|
wuyi
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-33850
|
SPARK-33828
EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled
|
Kousuke Saruta
|
Kousuke Saruta
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-33823
|
SPARK-33828
Use the `CastSupport.cast` method in HashJoin
|
Unassigned
|
Takeshi Yamamuro
|
|
Closed |
Duplicate
|
|
|
|
|
|
|
|
SPARK-33822
|
SPARK-33828
TPCDS Q5 fails if spark.sql.adaptive.enabled=true
|
Takeshi Yamamuro
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-33679
|
SPARK-33828
Enable spark.sql.adaptive.enabled true by default
|
Dongjoon Hyun
|
Dongjoon Hyun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-30186
|
SPARK-33828
support Dynamic Partition Pruning in Adaptive Execution
|
Ke Jia
|
Xiaoju Wu
|
|
Resolved |
Fixed
|
|
|
|
|