[YARN-10988] Spark application stuck at ACCEPTED state at spark-submit

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 3.2.1
• Component/s: applications
• Assignee: Unassigned
• Reporter: unical1988
• Created: 22/Oct/21 14:55
• Updated: 25/Oct/21 17:07
• Resolved: 22/Oct/21 17:34

Description

Hello,

 

I have configured & set Hadoop Cluster over 2 nodes and launch it along with Yarn like so : 

 

On the master node :

• hdfs namenode -regular
• yarn resourcemanager

 

On the slave node : 

• hdfs datanode -regular
• yarn nodemanager

And it shows through UI that there has been a connection established between the two machines that form the cluster.

To note that start-dfs on the master node started both namenode and datanode even after setting slaves and hosts files.

Now i submit an application (simple hello world) to Yarn : through this command :

Spark-submit --class "main" --master yarn pathToJar

 

But i get the error 

15/08/29 12:07:58 INFO Client: ApplicationManager is waiting for the ResourceManager 

client token: N/A diagnostics: N/A

ApplicationMaster host: N/A

ApplicationMaster RPC port: -1

queue: root.hdfs

start time: 1440864477580

final status: UNDEFINED tracking URL: http://chd2.moneyball.guru:8088/proxy/application_1440861466017_0007/ user: hdfs 15/08/29 12:07:59 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED) 15/08/29 12:08:00 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED) 15/08/29 12:08:01 INFO Client: Application report for application_1440861466017_0007 (state: ACCEPTED)...

 

What am i missing in my configuration ?