Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2151

spark-submit issue (int format expected for memory parameter)

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.0.1, 1.1.0
    • None
    • None

    Description

      Get this exception when invoking spark-submit in standalone cluster mode:

      Exception in thread "main" java.lang.NumberFormatException: For input string: "38g"
      	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
      	at java.lang.Integer.parseInt(Integer.java:492)
      	at java.lang.Integer.parseInt(Integer.java:527)
      	at scala.collection.immutable.StringLike$class.toInt(StringLike.scala:229)
      	at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
      	at org.apache.spark.deploy.ClientArguments.parse(ClientArguments.scala:55)
      	at org.apache.spark.deploy.ClientArguments.<init>(ClientArguments.scala:47)
      	at org.apache.spark.deploy.Client$.main(Client.scala:148)
      	at org.apache.spark.deploy.Client.main(Client.scala)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:606)
      	at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:292)
      	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:55)
      	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            nravi Nishkam Ravi
            nravi Nishkam Ravi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment