Hadoop安装遇到的各种异常及解决办法

╰半夏微凉° 2022-05-25 23:11 264阅读 0赞

**转自:https://blog.csdn.net/lifuxiangcaohui/article/details/39269479\#\#\#;**

异常一:

2014-03-13 11:10:23,665 INFO org.apache.[Hadoop][].ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)

2014-03-13 11:10:24,667 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:25,667 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:26,669 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:27,670 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:28,671 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:29,672 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:30,674 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:31,675 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:32,676 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: Linux-hadoop-38/10.10.208.38:9000. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)  
2014-03-13 11:10:32,677 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: Linux-hadoop-38/10.10.208.38:9000  
解决办法:  
1、ping Linux-hadoop-38能通,telnet Linux-hadoop-38 9000不能通，说明开启了防火墙  
2、去Linux-hadoop-38主机关闭防火墙/etc/init.d/iptables stop，显示:  
iptables：清除防火墙规则：\[确定\]  
iptables：将链设置为政策 ACCEPT：filter \[确定\]  
iptables：正在卸载模块：\[确定\]

3、重启

异常二：

2014-03-13 11:26:30,788 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for block pool Block pool BP-1257313099-10.10.208.38-1394679083528 (storage id DS-743638901-127.0.0.1-50010-1394616048958) service to Linux-hadoop-38/10.10.208.38:9000  
java.io.IOException: Incompatible clusterIDs in /usr/local/hadoop/tmp/dfs/data: namenode clusterID = CID-8e201022-6faa-440a-b61c-290e4ccfb006; datanode clusterID = clustername  
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:391)  
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:191)  
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:219)  
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:916)  
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:887)  
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:309)  
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:218)  
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:660)  
at java.lang.Thread.run(Thread.java:662)  
解决办法:  
1、在hdfs-site.xml配置文件中，配置了dfs.namenode.name.dir，在master中,该配置的目录下有个current文件夹，里面有个VERSION文件,内容如下:  
\#Thu Mar 13 10:51:23 CST 2014  
namespaceID=1615021223  
clusterID=CID-8e201022-6faa-440a-b61c-290e4ccfb006  
cTime=0  
storageType=NAME\_NODE  
blockpoolID=BP-1257313099-10.10.208.38-1394679083528  
layoutVersion=-40  
2、在core-site.xml配置文件中，配置了hadoop.tmp.dir，在slave中,该配置的目录下有个dfs/data/current目录，里面也有一个VERSION文件，内容  
\#Wed Mar 12 17:23:04 CST 2014  
storageID=DS-414973036-10.10.208.54-50010-1394616184818  
clusterID=clustername  
cTime=0  
storageType=DATA\_NODE  
layoutVersion=-40  
3、一目了然，两个内容不一样，导致的。删除slave中的错误内容，重启，搞定！

参考资料: [http://www.linuxidc.com/Linux/2014-03/98598.htm][http_www.linuxidc.com_Linux_2014-03_98598.htm]

异常三：

2014-03-13 12:34:46,828 FATAL org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Failed to initialize mapreduce\_shuffle  
java.lang.RuntimeException: No class defiend for mapreduce\_shuffle  
at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.init(AuxServices.java:94)  
at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)  
at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:181)  
at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:185)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:328)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)  
2014-03-13 12:34:46,830 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager  
java.lang.RuntimeException: No class defiend for mapreduce\_shuffle  
at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.init(AuxServices.java:94)  
at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)  
at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.init(ContainerManagerImpl.java:181)  
at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.init(NodeManager.java:185)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:328)  
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)  
2014-03-13 12:34:46,846 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.  
解决办法:  
1、yarn-site.xml配置错误:  
<property>  
<name>yarn.nodemanager.aux-services</name>  
<value>mapreduce\_shuffle</value>  
</property>  
2、修改为:  
<property>  
<name>yarn.nodemanager.aux-services</name>  
<value>mapreduce.shuffle</value>  
</property>  
3、重启服务

警告:  
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

解决办法:

参考  [http://www.linuxidc.com/Linux/2014-03/98599.htm][http_www.linuxidc.com_Linux_2014-03_98599.htm]

异常四：

14/03/13 17:25:41 ERROR lzo.GPLNativeCodeLoader: Could not load native gpl library  
java.lang.UnsatisfiedLinkError: no gplcompression in java.library.path  
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1734)  
at java.lang.Runtime.loadLibrary0(Runtime.java:823)  
at java.lang.System.loadLibrary(System.java:1028)  
at com.hadoop.compression.lzo.GPLNativeCodeLoader.<clinit>(GPLNativeCodeLoader.java:32)  
at com.hadoop.compression.lzo.LzoCodec.<clinit>(LzoCodec.java:67)  
at com.hadoop.compression.lzo.LzoIndexer.<init>(LzoIndexer.java:36)  
at com.hadoop.compression.lzo.LzoIndexer.main(LzoIndexer.java:134)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)  
14/03/13 17:25:41 ERROR lzo.LzoCodec: Cannot load native-lzo without native-hadoop  
14/03/13 17:25:43 INFO lzo.LzoIndexer: \[INDEX\] LZO Indexing file /test2.lzo, size 0.00 GB...  
Exception in thread "main" java.lang.RuntimeException: native-lzo library not available  
at com.hadoop.compression.lzo.LzopCodec.createDecompressor(LzopCodec.java:91)  
at com.hadoop.compression.lzo.LzoIndex.createIndex(LzoIndex.java:222)  
at com.hadoop.compression.lzo.LzoIndexer.indexSingleFile(LzoIndexer.java:117)  
at com.hadoop.compression.lzo.LzoIndexer.indexInternal(LzoIndexer.java:98)  
at com.hadoop.compression.lzo.LzoIndexer.index(LzoIndexer.java:52)  
at com.hadoop.compression.lzo.LzoIndexer.main(LzoIndexer.java:137)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)

解决办法:很明显，没有native-lzo  
编译安装/编译lzo，[http://www.linuxidc.com/Linux/2014-03/98601.htm][http_www.linuxidc.com_Linux_2014-03_98601.htm]

异常五:

14/03/17 10:23:59 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/hadoop/.staging/job\_1394702706596\_0003  
java.lang.IllegalArgumentException: Compression codec com.hadoop.compression.lzo.LzoCodec not found.  
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:134)  
at org.apache.hadoop.io.compress.CompressionCodecFactory.<init>(CompressionCodecFactory.java:174)  
at org.apache.hadoop.mapreduce.lib.input.TextInputFormat.isSplitable(TextInputFormat.java:58)  
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:276)  
at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:468)  
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:485)  
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:369)  
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1269)  
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1266)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:396)  
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)  
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1266)  
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1287)  
at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)  
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)  
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)  
Caused by: java.lang.ClassNotFoundException: Class com.hadoop.compression.lzo.LzoCodec not found  
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1680)  
at org.apache.hadoop.io.compress.CompressionCodecFactory.getCodecClasses(CompressionCodecFactory.java:127)  
... 26 more  
临时解决办法：  
将/usr/local/hadoop/lib/hadoop-lzo-0.4.10.jar拷贝到/usr/local/jdk/lib下，重启linux

异常六:

14/03/17 10:35:03 ERROR security.UserGroupInformation: PriviledgedActionException as:[Hadoop][] (auth:SIMPLE) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /tmp/hadoop-yarn/staging/hadoop/.staging/job\_1395023531587\_0001. Name node is in safe mode.  
The reported blocks 0 needs additional 12 blocks to reach the threshold 0.9990 of total blocks 12. Safe mode will be turned off automatically.  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:2905)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInt(FSNamesystem.java:2872)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2859)  
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:642)  
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:408)  
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44968)  
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)  
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)  
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)  
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:396)  
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)  
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)  
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.SafeModeException): Cannot delete /tmp/hadoop-yarn/staging/hadoop/.staging/job\_1395023531587\_0001. Name node is in safe mode.  
The reported blocks 0 needs additional 12 blocks to reach the threshold 0.9990 of total blocks 12. Safe mode will be turned off automatically.  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInternal(FSNamesystem.java:2905)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.deleteInt(FSNamesystem.java:2872)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2859)  
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:642)  
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:408)  
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44968)  
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)  
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)  
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)  
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:396)  
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)  
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)  
at org.apache.hadoop.ipc.Client.call(Client.java:1238)  
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)  
at $Proxy9.delete(Unknown Source)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)  
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)  
at $Proxy9.delete(Unknown Source)  
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:408)  
at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1487)  
at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:355)  
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:418)  
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1269)  
at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1266)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:396)  
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)  
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1266)  
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1287)  
at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)  
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144)  
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:68)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
at java.lang.reflect.Method.invoke(Method.java:597)  
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)  
解决办法：  
明显是安全模式：  
原因是reboot机器的时候，防火墙起来了，导致NodeManager启动不起来，导致一直是安全模式。关闭防火墙重启hadoop，ok！

异常七：

2014-03-20 10:35:10,447 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times  
2014-03-20 10:35:10,450 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033  
2014-03-20 10:35:10,450 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0  
2014-03-20 10:35:10,450 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000  
2014-03-20 10:35:10,476 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/local/hadoop/hdfs/name/in\_use.lock acquired by nodename 9580@Linux-hadoop-38  
2014-03-20 10:35:10,479 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...  
2014-03-20 10:35:10,480 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.  
2014-03-20 10:35:10,480 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.  
2014-03-20 10:35:10,480 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode join  
java.io.IOException: NameNode is not formatted.  
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:217)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:728)  
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:521)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:403)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:437)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:613)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:598)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1169)  
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1233)  
2014-03-20 10:35:10,484 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1  
2014-03-20 10:35:10,501 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN\_MSG:   
解决办法:  
hadoop namenode -format,不是hdfs namenode -format

启动JobHistoryServer  
sbin/mr-jobhistory-daemon.sh start historyserver

异常八：

[Datanode denied communication with namenode: DatanodeRegistration 解决办法][Datanode denied communication with namenode_ DatanodeRegistration]

Hadoop版本：2.2.0

单机伪同步环境。

启动start-dfs.sh后，发现本地没有datanode进程，查看datanode的日志如下：

2014-03-24 23:48:11,357 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-1316134947-127.0.0.1-1395699640023 (storage id DS-2053126411-127.0.0.1-50010-1395699655564) service to localhost/192.168.1.101:9000 beginning handshake with NN

2014-03-24 23:48:11,381 FATAL org.apache.hadoop.hdfs.server.datanode .DataNode: Initialization failed for block pool Block pool BP \-1316134947-127.0.0.1-1395699640023 (storage id DS-2053126411- 127.0.0.1 \-50010-1395699655564) service to localhost/ 192.168.1.101 :9000  
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.protocol.DisallowedDatanodeException): Datanode denied communication with namenode: DatanodeRegistration(0.0.0.0 , storageID=DS-2053126411- 127.0.0.1 \-50010-1395699655564, infoPort=50075, ipcPort=50020, storageInfo=lv=-47;cid=CID-ba95b66c-d94b-4390-8d44-adb486ba5682;nsid=2073699254;c=0)  
 at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:739)  
 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:3929)  
 at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:948)  
 at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:90)  
 at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:24079)  
 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)  
 at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)  
 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2048)  
 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2044)  
 at java.security.AccessController.doPrivileged(Native Method)  
 at javax.security.auth.Subject.doAs(Subject.java:394)  
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)  
 at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2042)  
  
  
 at org.apache.hadoop.ipc.Client.call(Client.java:1347)  
 at org.apache.hadoop.ipc.Client.call(Client.java:1300)  
 at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)  
 at com.sun.proxy.$Proxy9.registerDatanode(Unknown Source)  
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)  
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)  
 at java.lang.reflect.Method.invoke(Method.java:597)  
 at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)  
 at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)  
 at com.sun.proxy.$Proxy9.registerDatanode(Unknown Source)  
 at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolClientSideTranslatorPB.registerDatanode(DatanodeProtocolClientSideTranslatorPB.java:146)  
 at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.register(BPServiceActor.java:623)  
 at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:225)  
 at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:664)  
 at java.lang.Thread.run(Thread.java:695)  
2014-03-24 23:48:11,382 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool BP-1316134947-127.0.0.1-1395699640023 (storage id DS-2053126411-127.0.0.1-50010-1395699655564) service to localhost/192.168.1.101:9000  
2014-03-24 23:48:11,484 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool BP-1316134947-127.0.0.1-1395699640023 (storage id DS-2053126411-127.0.0.1-50010-1395699655564)  
2014-03-24 23:48:11,484 INFO org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Removed bpid=BP-1316134947-127.0.0.1-1395699640023 from blockPoolScannerMap  
2014-03-24 23:48:11,484 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Removing block pool BP-1316134947-127.0.0.1-1395699640023  
2014-03-24 23:48:13,485 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode  
2014-03-24 23:48:13,486 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0  
2014-03-24 23:48:13,487 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN\_MSG:   
/\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*  
SHUTDOWN\_MSG: Shutting down DataNode at localhost/127.0.0.1

\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*/

导致这个问题的原因很多，在stackoverflow上有很多解决方案，但都不适用我。经过摸索，通过修改/etc/hosts解决。

/etc/hosts原来为：

127.0.0.1  localhost

由于我本机IP地址为 192.168.1.101，所以将hosts文件修改为这个ip地址：

192.168.1.101 localhost

理论上127.0.0.1也是可行的，但不知道我的为什么不行。

修改后，重新删除dfs.namenode.name.dir和dfs.datanode.data.dir以及hadoop.tmp.dir目录，分别执行：

hdfs namenode -format

start-dfs.sh

start-yarn.sh

后，用jps查看服务，全部正常：

37619 NodeManager

37798 Jps

37247 NameNode

37330 DataNode

37536 ResourceManager

37432 SecondaryNameNode

[Hadoop]: http://www.linuxidc.com/topicnews.aspx?tid=13
[http_www.linuxidc.com_Linux_2014-03_98598.htm]: http://www.linuxidc.com/Linux/2014-03/98598.htm
[http_www.linuxidc.com_Linux_2014-03_98599.htm]: http://www.linuxidc.com/Linux/2014-03/98599.htm
[http_www.linuxidc.com_Linux_2014-03_98601.htm]: http://www.linuxidc.com/Linux/2014-03/98601.htm
[Datanode denied communication with namenode_ DatanodeRegistration]: http://blog.csdn.net/tanggod/article/details/22029287