Details
-
Umbrella
-
Status: Resolved
-
Critical
-
Resolution: Done
-
3.1.0
-
None
Description
Currently, PySpark documentation (https://spark.apache.org/docs/latest/api/python/index.html) is pretty much poorly written compared to other projects.
See, for example, see Koalas https://koalas.readthedocs.io/en/latest/ as an example.
PySpark is being more and more important in Spark, and we should improve this documentation so people can easily follow.
Reference:
Attachments
Issue Links
- contains
-
SPARK-32185 User Guide - Monitoring
- Resolved
-
SPARK-32391 Install pydata_sphinx_theme in Jenkins machines
- Resolved
- is duplicated by
-
SPARK-31852 Redesign PySpark documentation
- Resolved
- is related to
-
SPARK-32204 Binder Integration
- Resolved
-
SPARK-32584 Exclude _images and _sources that are generated by Sphinx in Jekyll build
- Resolved
1.
|
Replace and redesign the documentation base | Resolved | Hyukjin Kwon | |
2.
|
Main Page | Resolved | Hyukjin Kwon | |
3.
|
Getting Started - Installation | Resolved | Rohit Mishra | |
4.
|
Getting Started - Package Overview | Resolved | Unassigned | |
5.
|
Getting Started - Quickstart | Resolved | Hyukjin Kwon | |
6.
|
User Guide - PySpark Usage Guide for Pandas with Apache Arrow | Resolved | Hyukjin Kwon | |
7.
|
User Guide - Shipping Python Package | Resolved | Fabian Höring | |
8.
|
API Reference | Resolved | Hyukjin Kwon | |
9.
|
Development - Setting up PyCharm | Resolved | Haejoon Lee | |
10.
|
Development - Contribution Guide | Resolved | Hyukjin Kwon | |
11.
|
Development - Testing PySpark | Resolved | Hyukjin Kwon | |
12.
|
Development - Debugging | Resolved | Hyukjin Kwon | |
13.
|
Migration Guide | Resolved | L. C. Hsieh | |
14.
|
Restructure and improve Python package management page | Resolved | Hyukjin Kwon | |
15.
|
Miscellaneous cleanup for new PySpark documentation | Resolved | Hyukjin Kwon | |
16.
|
Supplement the description for Python Package Management | Resolved | Haejoon Lee |