Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10988

Spark application stuck at ACCEPTED state at spark-submit

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • 3.2.1
    • None
    • applications
    • None

    Description

      Hello,

       

      I have configured & set Hadoop Cluster over 2 nodes and launch it along with Yarn like so : 

       

      On the master node :

      • hdfs namenode -regular
      • yarn resourcemanager

       

      On the slave node : 

      • hdfs datanode -regular
      • yarn nodemanager

      And it shows through UI that there has been a connection established between the two machines that form the cluster.

      To note that start-dfs on the master node started both namenode and datanode even after setting slaves and hosts files.

      Now i submit an application (simple hello world) to Yarn : through this command :

      Spark-submit --class "main" --master yarn pathToJar

       

      But i get the error 

      15/08/29 12:07:58 INFO Client: ApplicationManager is waiting for the ResourceManager 

      client token: N/A diagnostics: N/A

      ApplicationMaster host: N/A

      ApplicationMaster RPC port: -1

      queue: root.hdfs

      start time: 1440864477580

      final status: UNDEFINED tracking URL: http://chd2.moneyball.guru:8088/proxy/application_1440861466017_0007/ user: hdfs 15/08/29 12:07:59 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED) 15/08/29 12:08:00 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED) 15/08/29 12:08:01 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED)...

       

      What am i missing in my configuration ?

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            unical1988 unical1988
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: