[SPARK-49184] PySpark Native Plotting

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 4.0.0
• Component/s: PySpark
• Assignee: Xinrong Meng
• Reporter: Ruifeng Zheng
• Created: 09/Aug/24 10:00
• Updated: 06/Sep/24 09:47

Issue Links

• relates to: SPARK-49530 PySpark Plotting API

Sub-Tasks

• Reimplement kde plot with Spark SQL: Resolved
• Compute multiple column kde plots with single pass: Resolved
• Reimplement hist plot with Spark SQL: Resolved
• Apply ArrayBinarySearch for histogram: Resolved
• Add expression for `java.util.Arrays.binarySearch`: Resolved
• Simplify the StringIndexer.countByValue with builtin functions: Resolved
• Simplify the bucket aggregation in hist plot: Resolved
• Parallelize the KDE computation for plotly backend: Resolved
• DataFrame boxplot supports fliers: Resolved
• Boxplot select outliers by distance from fences: Resolved
• Compute all box plot metrics in single job: Resolved
• Optimize ArrayBinarySearch for foldable array: Open
• Apply Reservoir sampling in `SampledPlotBase`: Resolved
• Switch `Scatter` plot to sampled data: Resolved