Uploaded image for project: 'S2Graph'
  1. S2Graph
  2. S2GRAPH-184

spark driver exit abnormally in the loader of s2jobs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 0.2.1
    • None
    • None
    • None
    • Spark 2.3.0 ,hbase 1.3.1 , hadoop 2.7.3

    Description

      Spark driver exit abnormally  and yarn would retry 3 times in s2jobs class  org.apache.s2graph.s2jobs.loader.GraphFileGenerator. Driver report ：
       
      ApplicationMaster: Final app status: FAILED, exitCode: 16, (reason: Shutdown hook called before final status was reported.)

       

      Which cause by  System.exit(0) in GraphFileGenerator.scala before sc.stop() was called.

       

      Attachments

        Activity

          People

            steamshon Do Yung Yoon
            sandyskies chenmingjie
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: