Bulk Operation

SPARK-37375 SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict

SPARK-37375 SPJ: Support Transfrom Expressions for One Side Shuffle

SPARK-37375 Improve picking the side of partially clustered distribution accroding to partition size

SPARK-37375 SPJ : Dynamically rebalance number of buckets when they are not equal

SPARK-37375 SPJ: Handle empty input partitions after dynamic filtering

SPARK-37375 SPJ: Refactor logic to handle partially clustered distribution

SPARK-37375 SPJ: Include keyGroupedPartitioning in StoragePartitionJoinParams equality check

SPARK-37375 SPJ: Support SPJ when join key is subset of partition keys

SPARK-37375 SPJ: Results duplicated when SPJ partial-cluster and pushdown enabled but conditions unmet

SPARK-37375 SPJ: encapsulate all SPJ related parameters in BatchScanExec

SPARK-37375 SPJ: Introduce a new API for V2 input partition to report partition size

SPARK-37375 SPJ: Remove Option in KeyGroupedPartitioning#partitionValues

SPARK-37375 SPJ: Support partially clustered distribution

SPARK-37375 SPJ: Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning

SPARK-37375 SPJ: Spark shouldn't assume InternalRow implements equals and hashCode

SPARK-37375 SPJ: Avoid shuffle when partition keys mismatch, but join expressions are compatible

SPARK-37375 SPJ: Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match

SPARK-37375 SPJ: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys

SPARK-37375 SPJ: Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

SPARK-37375 SPJ: Initial implementation of Storage-Partitioned Join

SPARK-37375 SPJ: Introduce a new DataSource V2 interface HasPartitionKey

SPARK-37375 SPIP: Storage Partitioned Join