Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-35435

Not able to capture driver and executor logs in console

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0
    • Fix Version/s: None
    • Component/s: Spark Submit
    • Labels:
    • Environment:

      Production

    • Docs Text:
      Hide
      Running the spark job using the below command, but not able to capture the driver and executor logs in console

      # Run on a Spark standalone cluster in cluster deploy mode with supervise
      ./bin/spark-submit \ --class org.apache.spark.examples.SparkPi \ --master spark://207.184.161.138:7077 \ --deploy-mode cluster \ --supervise \ --executor-memory 20G \ --total-executor-cores 100 \ /path/to/examples.jar \ 1000
      Show
      Running the spark job using the below command, but not able to capture the driver and executor logs in console # Run on a Spark standalone cluster in cluster deploy mode with supervise ./bin/spark-submit \ --class org.apache.spark.examples.SparkPi \ --master spark://207.184.161.138:7077 \ --deploy-mode cluster \ --supervise \ --executor-memory 20G \ --total-executor-cores 100 \ /path/to/examples.jar \ 1000

      Description

      Running the spark job using the below command, but not able to capture the driver and executor logs in console
        # # Run on a Spark standalone cluster in cluster deploy mode with supervise

      1. ./bin/spark-submit \ --class org.apache.spark.examples.SparkPi \ --master spark://207.184.161.138:7077 \ --deploy-mode cluster \ --supervise \ --executor-memory 20G \ --total-executor-cores 100 \ /path/to/examples.jar \ 1000

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Sugumar.Vijay78 Sugumar
              Shepherd:
              Apache Spark
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 168h
                168h
                Remaining:
                Remaining Estimate - 168h
                168h
                Logged:
                Time Spent - Not Specified
                Not Specified