Raunak Agarwal Raunak Agarwal - 1 year ago 103
Java Question

Hadoop: TaskTracker and JobTracker don't start with start-dfs.sh

I am trying to set up hadoop 0.22.0 on my laptop for learning purpose using this link


When I run the script start-dfs.sh this is the ouput

starting namenode, logging to /usr/local/hadoop/bin/../logs/hadoop-raunak-namenode-ubuntu.out
localhost: starting datanode, logging to /usr/local/hadoop/bin/../logs/hadoop-raunak-datanode-ubuntu.out
localhost: starting secondarynamenode, logging to /usr/local/hadoop/bin/../logs/hadoop-raunak-secondarynamenode-ubuntu.out

The output for the jps command is:

18106 Jps
17269 NameNode
17556 DataNode
17845 SecondaryNameNode

But I can't see the TaskTracker or JobTracker running. So, can anyone please tell me what could I be missing. I am a total newbie and don't know what information is required. So, please let me know.

Answer Source

I agree with Chris Gerken's comment, you're running the start-dfs.sh script, which only starts the HDFS services. You'll need to run start-mapred.sh if you want the map reduce services (job tracker and task trackers).

Also, the deprecated message from start-all.sh hints towards this:

echo "This script is Deprecated. Instead use start-dfs.sh and start-mapred.sh"
Recommended from our users: Dynamic Network Monitoring from WhatsUp Gold from IPSwitch. Free Download