Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3522

Make spark-ec2 verbosity configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • None
    • None
    • EC2

    Description

      When launching a cluster, spark-ec2 spits out a lot of stuff that feels like debug output. It would be better for the user if spark-ec2 did the following:

      • default to info output level
      • allow option to increase verbosity and include debug output

      This will require converting most of the print statements in the script to use Python's logging module and setting output levels (INFO, WARN, DEBUG) for each statement.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nchammas Nicholas Chammas
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: