[SPARK-49531] Support line plot with plotly backend

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, PySpark
• Labels: pull-request-available
• Assignee: Xinrong Meng
• Reporter: Xinrong Meng
• Created: 06/Sep/24 06:12
• Updated: 23/Sep/24 01:32
• Resolved: 13/Sep/24 01:21

Description

While Pandas on Spark supports plotting, PySpark currently lacks this feature. The proposed API will enable users to generate visualizations, such as line plots, by leveraging libraries like Plotly. This will provide users with an intuitive, interactive way to explore and understand large datasets directly from PySpark DataFrames, streamlining the data analysis workflow in distributed environments.

 

See more at https://docs.google.com/document/d/1IjOEzC8zcetG86WDvqkereQPj_NGLNW7Bdu910g30Dg/edit?usp=sharing for PySpark Plotting API Specification.

 

Issue Links

• links to: GitHub Pull Request #48008
• links to: GitHub Pull Request #48139