[SPARK-1351] Documentation Improvements for Spark 1.0

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: Documentation
• Assignee: Matei Alexandru Zaharia
• Reporter: Patrick Wendell
• Created: 29/Mar/14 21:32
• Updated: 02/Mar/15 16:12
• Resolved: 02/Mar/15 16:12

Description

Umbrella to track necessary doc improvements. We can break these out into other JIRA's over time.

• Use grouping in the RDD and SparkContext scaladocs. See Schema RDD:
  http://people.apache.org/~pwendell/catalyst-docs/api/sql/core/index.html#org.apache.spark.sql.SchemaRDD
• Use spark-submit script wherever possible in docs.
• Have package-level documentation in Scaladoc. Also these can be grouped so that the o.a.s package doc looks nice.