Step 1 of 4: Choose Issues

Cancel

T Patch Info Key Summary Assignee Reporter P Status Resolution Created Updated Due Development
Sub-task SPARK-38697

SPARK-37063 Extend SparkSessionExtensions to inject rules into AQE Optimizer

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-38578

SPARK-37063 Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

Unassigned XiDuo You Major In Progress Unresolved  
Sub-task SPARK-38519

SPARK-37063 AQE throw exception should respect SparkFatalException

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-38406

SPARK-37063 Improve perfermance of ShufflePartitionsUtil createSkewPartitionSpecs

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-38401

SPARK-37063 Unify get preferred locations for shuffle in AQE

Unassigned XiDuo You Major In Progress Unresolved  
Sub-task SPARK-38232

SPARK-37063 Explain formatted does not collect subqueries under query stage in AQE

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-38162

SPARK-37063 Optimize one row plan in normal and AQE Optimizer

Unassigned XiDuo You Major Resolved Fixed  
Sub-task SPARK-38030

SPARK-37063 Query with cast containing non-nullable columns fails with AQE on Spark 3.1.1

Shardul Mahadik Shardul Mahadik Major Resolved Fixed  
Sub-task SPARK-38013

SPARK-37063 AQE can change bhj to smj if no extra shuffle introduce

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-37995

SPARK-37063 TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

XiDuo You Kapil Singh Major Resolved Fixed  
Sub-task SPARK-37652

SPARK-37063 Support optimize skewed join through union

Unassigned mcdull_zhang Minor Resolved Fixed  
Sub-task SPARK-37442

SPARK-37063 In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure

Michael Chen Michael Chen Major Resolved Fixed  
Sub-task SPARK-37357

SPARK-37063 Add small partition factor for rebalance partitions

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-37328

SPARK-37063 SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan

Wenchen Fan Lietong Liu Major Resolved Fixed  
Sub-task SPARK-37267

SPARK-37063 OptimizeSkewInRebalancePartitions support optimize non-root node

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-37043

SPARK-37063 Cancel all running job after AQE plan finished

Unassigned XiDuo You Major In Progress Unresolved  
Sub-task SPARK-36652

SPARK-37063 AQE dynamic join selection should not apply to non-equi join

Cheng Su Cheng Su Minor Resolved Fixed  
Sub-task SPARK-36443

SPARK-37063 Demote BroadcastJoin causes performance regression and increases OOM risks

Unassigned Kent Yao Major Open Unresolved  
Sub-task SPARK-36424

SPARK-37063 Support eliminate limits in AQE Optimizer

XiDuo You XiDuo You Major Resolved Fixed  
Sub-task SPARK-35540

SPARK-37063 Make config maxShuffledHashJoinLocalMapThreshold fallback to advisoryPartitionSizeInBytes

Unassigned XiDuo You Major In Progress Unresolved  
Sub-task SPARK-35414

SPARK-37063 Completely fix the broadcast timeout issue in AQE

Unassigned Yu Zhong Major Resolved Duplicate  
Sub-task SPARK-34980

SPARK-37063 Support coalesce partition through union

XiDuo You XiDuo You Minor Resolved Fixed  
Sub-task SPARK-34827

SPARK-37063 Support fetching shuffle blocks in batch with i/o encryption

Unassigned Dongjoon Hyun Blocker Reopened Unresolved  
Sub-task SPARK-33832

SPARK-37063 Add an option in AQE to mitigate skew even if it causes an new shuffle

XiDuo You Eugene Koifman Major Resolved Fixed  
Sub-task SPARK-32304

SPARK-37063 Flaky Test: AdaptiveQueryExecSuite.multiple joins

Unassigned Hyukjin Kwon Major Resolved Cannot Reproduce  

Cancel