Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24363

spark context exit abnormally

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.1.2
    • Fix Version/s: None
    • Component/s: Java API, Spark Submit, YARN
    • Labels:
      None
    • Environment:

      spark2.1.2   
      hadoop2.6.0-cdh5.4.7
       
       

      Description

      I create a sparkcontext instance with yarn-client mode in my program (a web application) for users to submit their jobs ,It can work for a for a period of time, but then it suddenly comes out without any new job running.It looks like the context has been killed, and I'm not sure whether the problem is on the yarn or on the spark.

      You can see my screenshot and log file.

       

       

        Attachments

        1. error_log.txt
          1 kB
          nilone
        2. QQ图片20180523162543.png
          100 kB
          nilone

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              nilone nilone
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: