Uploaded image for project: 'Eagle (Retired)'
  1. Eagle (Retired)
  2. EAGLE-1022

Configuration parsing exception in SparkHistoryJob app

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • v0.5.0
    • v0.5.0
    • None
    • None

    Description

      java.lang.NumberFormatException: For input string: "2g"
              at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) ~[na:1.8.0_91]
              at java.lang.Integer.parseInt(Integer.java:580) ~[na:1.8.0_91]
              at java.lang.Integer.parseInt(Integer.java:615) ~[na:1.8.0_91]
              at org.apache.eagle.jpm.util.Utils.parseMemory(Utils.java:78) ~[stormjar.jar:na]
              at org.apache.eagle.jpm.spark.history.crawl.JHFSparkEventReader.getMemoryOverhead(JHFSparkEventReader.java:490) ~[stormjar.jar:na]
              at org.apache.eagle.jpm.spark.history.crawl.JHFSparkEventReader.clearReader(JHFSparkEventReader.java:449) ~[stormjar.jar:na]
              at org.apache.eagle.jpm.spark.history.crawl.JHFSparkParser.parse(JHFSparkParser.java:53) ~[stormjar.jar:na]
              at org.apache.eagle.jpm.spark.history.crawl.SparkFilesystemInputStreamReaderImpl.read(SparkFilesystemInputStreamReaderImpl.java:47) ~[stormjar.jar:na]
              at org.apache.eagle.jpm.spark.history.storm.SparkHistoryJobParseBolt.execute(SparkHistoryJobParseBolt.java:98) ~[stormjar.jar:na]
              at backtype.storm.daemon.executor$fn__5697$tuple_action_fn__5699.invoke(executor.clj:659) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.daemon.executor$mk_task_receiver$fn__5620.invoke(executor.clj:415) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.disruptor$clojure_handler$reify__1741.onEvent(disruptor.clj:58) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.daemon.executor$fn__5697$fn__5710$fn__5761.invoke(executor.clj:794) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at backtype.storm.util$async_loop$fn__452.invoke(util.clj:465) [storm-core-0.9.3.2.2.0.0-2041.jar:0.9.3.2.2.0.0-2041]
              at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
              at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]
      

      Attachments

        Issue Links

          Activity

            githubbot ASF GitHub Bot added a comment -

            GitHub user qingwen220 opened a pull request:

            https://github.com/apache/eagle/pull/934

            EAGLE-1022: Fix runtime exception when parsing spark.yarn.executor.memoryOverhead

            https://issues.apache.org/jira/browse/EAGLE-1022

            You can merge this pull request into a Git repository by running:

            $ git pull https://github.com/qingwen220/eagle EAGLE-1022

            Alternatively you can review and apply these changes as the patch at:

            https://github.com/apache/eagle/pull/934.patch

            To close this pull request, make a commit to your master/trunk branch
            with (at least) the following in the commit message:

            This closes #934


            commit 20b16bb23245a792065f3ccd981ef5d14792e2b4
            Author: Zhao, Qingwen <qingwzhao@apache.org>
            Date: 2017-05-17T03:13:09Z

            fix runtime exception when parse spark.yarn.executor.memoryOverhead


            githubbot ASF GitHub Bot added a comment - GitHub user qingwen220 opened a pull request: https://github.com/apache/eagle/pull/934 EAGLE-1022 : Fix runtime exception when parsing spark.yarn.executor.memoryOverhead https://issues.apache.org/jira/browse/EAGLE-1022 You can merge this pull request into a Git repository by running: $ git pull https://github.com/qingwen220/eagle EAGLE-1022 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/eagle/pull/934.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #934 commit 20b16bb23245a792065f3ccd981ef5d14792e2b4 Author: Zhao, Qingwen <qingwzhao@apache.org> Date: 2017-05-17T03:13:09Z fix runtime exception when parse spark.yarn.executor.memoryOverhead
            githubbot ASF GitHub Bot added a comment -

            Github user asfgit closed the pull request at:

            https://github.com/apache/eagle/pull/934

            githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/eagle/pull/934

            People

              qingwzhao Qingwen Zhao
              qingwzhao Qingwen Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: