Trivial Description
I am new to hadoop ecosystem. I am setting up a cluster with 4 nodes, one master and 3 slave nodes. I have done the ground work of updating all xml files in hadoop/etc/hadoop folder. I saved the slaves file. I formatted the namenode. I then started the cluster with command, sbin/start-dfs.sh. I get to see the lines:
'starting namenode on localhost.... starting datanode on slave1...starting datanode on slave2...starting datanode on slave3... starting secondary namenode..... But when I run jps command in the terminal of masternode, I see only Jps and Secondary Namenode. When I run jps command on the slave nodes, I see only Jps, no datanode running on the slaves. What should I write in my hdfs-site.xml? Currently I set the path for namenode and datanode like... <value>file:/home/user/hadoop_store/hdfs/namenode<\value> and similarly for datanode as well. In the log file for namenode, I see the line saying "Inconsistent state: storage directory doesn't exist or not accessible for the path /home/user/hadoop_store/hdfs/namenode.