Uploaded image for project: 'Livy'
  1. Livy
  2. LIVY-160

Document essential Spark Configs in POST sessions/batches

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.3
    • 0.9.0
    • Docs
    • None

    Description

      per der discussion in LIVY-158

      re: documentation, I'm fine with writing better documentation. Some basic configs + a link to Spark's documentation is fine. I just don't want to get into the business of replicating half of Spark's documentation in Livy, just like I don't want to replicate Spark's functionality in this area.

      CLI args provided by spark-submit are very frequently used during job submission, and could be used as a reference to determine whenever a config is essential.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tc0312 Alex Man
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: