Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-8929

[Windows] Application with Appname including whiteSpace fails in Yarn-client mode

Rank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Abandoned
    • None
    • None
    • Windows, YARN
    • None

    Description

      Some MachineLearning examples has space in App Name. These applications fail to start AM with yarn-client mode in Windows environment.

      Affected Test example list:

      • BinaryClassification
      • Correlations
      • DecisionTreeRunner
      • DenseKmeans
      • GradientBoostedTreesRunner
      • LinearRegression
      • MovieLensALS
      • MultivariateSummarizer
      • SampledRDDs
      • SparseNaiveBayes
      SampledRDDs
      RUNNING: call spark-submit  --class org.apache.spark.examples.mllib.SampledRDDs --master yarn-client --properties-file c:\windows\temp\spark-defaults.conf --jars  spark-examples-*.jar  --input /tmp/sparkMLLInput/sample_binary_classification_data.txt 
      
      Fails to Start AM
      2015-06-13 22:07:27,526|beaver.machine|INFO|8888|7600|MainThread|Container id: container_e02_1434177640451_0029_02_000001
      2015-06-13 22:07:27,526|beaver.machine|INFO|8888|7600|MainThread|Exit code: 9009
      2015-06-13 22:07:27,528|beaver.machine|INFO|8888|7600|MainThread|Exception message: Usage: java [-options] class [args...]
      2015-06-13 22:07:27,529|beaver.machine|INFO|8888|7600|MainThread|(to execute a class)
      2015-06-13 22:07:27,529|beaver.machine|INFO|8888|7600|MainThread|or  java [-options] -jar jarfile [args...]
      2015-06-13 22:07:27,529|beaver.machine|INFO|8888|7600|MainThread|(to execute a jar file)
      2015-06-13 22:07:27,529|beaver.machine|INFO|8888|7600|MainThread|where options include:
      2015-06-13 22:07:27,530|beaver.machine|INFO|8888|7600|MainThread|-d32	  use a 32-bit data model if available
      2015-06-13 22:07:27,530|beaver.machine|INFO|8888|7600|MainThread|-d64	  use a 64-bit data model if available
      2015-06-13 22:07:27,532|beaver.machine|INFO|8888|7600|MainThread|-server	  to select the "server" VM
      2015-06-13 22:07:27,532|beaver.machine|INFO|8888|7600|MainThread|The default VM is server.
      2015-06-13 22:07:27,532|beaver.machine|INFO|8888|7600|MainThread|
      2015-06-13 22:07:27,532|beaver.machine|INFO|8888|7600|MainThread|-cp <class search path of directories and zip/jar files>
      2015-06-13 22:07:27,533|beaver.machine|INFO|8888|7600|MainThread|-classpath <class search path of directories and zip/jar files>
      2015-06-13 22:07:27,533|beaver.machine|INFO|8888|7600|MainThread|A ; separated list of directories, JAR archives,
      2015-06-13 22:07:27,535|beaver.machine|INFO|8888|7600|MainThread|and ZIP archives to search for class files.
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            yeshavora Yesha Vora
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment