Datanode process not running in Hadoop

Question

I have set up and configured a multi-node Hadoop cluster in my system

Now i try to start all daemons by running start-all.sh command, it shows all the processes initializing properly as follows:

starting namenode, logging to /usr/local/hadoop/libexec/../logs/hadoop1-root-namenode-hadoop.out
hadoop1: starting datanode, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-datanode-hadoop1.out
hadoop2: starting datanode, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-datanode-hadoop2.out
hadoop1: starting secondarynamenode, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-secondarynamenode-hadoop1.out
starting jobtracker, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-jobtracker-hadoop1.out
hadoop1: starting tasktracker, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-tasktracker-hadoop1.out
hadoop2: starting tasktracker, logging to /usr/local/hadoop/libexec/../logs/hadoop-root-tasktracker-hadoop2.out

However, when I type the jps command, I get the following output:

31057 NameNode
4001 RunJar
6182 RunJar
31328 SecondaryNameNode
31411 JobTracker
32119 Jps
31560 TaskTracker

Can someone tell me the solution for this?

Answer 1

You need to do something like this:

• bin/stop-all.sh (or stop-dfs.sh and stop-yarn.sh in the 2.x serie)
• rm -Rf /app/tmp/hadoop-your-username/*
• bin/hadoop namenode -format

Answer 2

Try to start the each process manually.

Comments

Can you mention how to do that?

---

Yes. These are the command to manually start them:

./Stop-all.sh
./hadoop-daemon.sh start namenode
./hadoop-daemon.sh start datanode
./yarn-daemon.sh start resourcemanager
./yarn-daemon.sh start nodemanager
./mr-jobhistory-daemon.sh start historyserver

Hope this helped ..

---

This worked for me.. Thanks

Answer 3

First stop the process by running

Stop-all.sh

Then go to the path where you have installed Hadoop. In that, go to the bin folder and run

hadoop datanode

This should work

Answer 4

Run the following commands:

Stop-all.sh 

start-dfs.sh 

start-yarn.sh 

mr-jobhistory-daemon.sh start historyserver