Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22069

Web access java.lang.OutOfMemoryError: Java heap space

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • 1.6.3
    • None
    • Web UI
    • None

    Description

      I running Spark 1.6.3, sometime I can not access web spark UI application.
      I get error 500 code and java.lang.OutOfMemoryError: Java heap space.

      <html>
      <head>
      <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
      <title>Error 500 Server Error</title>
      </head>
      <body><h2>HTTP ERROR 500</h2>
      <p>Problem accessing /jobs/. Reason:
      <pre> Server Error</pre></p><h3>Caused by:</h3><pre>java.lang.OutOfMemoryError: Java heap space
      at java.util.Arrays.copyOf(Arrays.java:3332)
      at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)
      at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)
      at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)
      at java.lang.StringBuilder.append(StringBuilder.java:136)
      at scala.StringContext.standardInterpolator(StringContext.scala:123)
      at scala.StringContext.s(StringContext.scala:90)
      at org.apache.spark.ui.jobs.AllJobsPage.makeTimeline(AllJobsPage.scala:204)
      at org.apache.spark.ui.jobs.AllJobsPage.render(AllJobsPage.scala:339)
      at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:79)
      at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:79)
      at org.apache.spark.ui.JettyUtils$$anon$1.doGet(JettyUtils.scala:79)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:735)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
      at org.spark-project.jetty.servlet.ServletHolder.handle(ServletHolder.java:684)
      at org.spark-project.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1507)
      at org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.doFilter(AmIpFilter.java:179)
      at org.spark-project.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1478)
      at org.spark-project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:499)
      at org.spark-project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086)
      at org.spark-project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:427)
      at org.spark-project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020)
      at org.spark-project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
      at org.spark-project.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
      at org.spark-project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
      at org.spark-project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
      at org.spark-project.jetty.server.Server.handle(Server.java:370)
      at org.spark-project.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494)
      at org.spark-project.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:973)
      at org.spark-project.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1035)
      at org.spark-project.jetty.http.HttpParser.parseNext(HttpParser.java:641)
      at org.spark-project.jetty.http.HttpParser.parseAvailable(HttpParser.java:231)
      </pre>

      Attachments

        Activity

          People

            Unassigned Unassigned
            hoangle hoangle
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: