hadoop格式化namenode时报异常： URI has an authority component

谁借莪１个温暖的怀抱￠ 2022-05-27 01:11 368阅读 0赞

今天部署2.7.1时在格式化namenode时遇到下面的错误

**\[html\]** [view plain][] [copy][view plain]

1.  省略前面部分....... 
2.  16/10/26 18:32:45 ERROR namenode.NameNode: Failed to start namenode. 
3.  java.lang.IllegalArgumentException: URI has an authority component 
4.   at java.io.File.<init>(File.java:423) 
5.   at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:329) 
6.   at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournals(FSEditLog.java:276) 
7.   at org.apache.hadoop.hdfs.server.namenode.FSEditLog.initJournalsForWrite(FSEditLog.java:247) 
8.   at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:985) 
9.   at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1429) 
10.  at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554) 
11. 16/10/26 18:32:45 INFO util.ExitUtil: Exiting with status 1 
12. 16/10/26 18:32:45 INFO namenode.NameNode: SHUTDOWN\_MSG: 
13. /\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* 
14. SHUTDOWN\_MSG: Shutting down NameNode at poseidon01/192.168.61.120 
15. \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*/

错误的原因是hdfs-site.xml配置文件中dfs.namenode.name.dir配置的有问题：

错误配置：

**\[html\]** [view plain][] [copy][view plain]

1.  <property>
2.  <name>dfs.namenode.name.dir</name>
3.  <value>file://data01/hadoop/dfs/name</value>
4.  </property>

正确配置：

**\[html\]** [view plain][] [copy][view plain]

1.  <property>
2.  <name>dfs.namenode.name.dir</name>
3.  <value>file:/data01/hadoop/dfs/name</value>
4.  </property>

说明:上面只是列出了hdfs-site.xml配置文件中关于dfs.namenode.name.dir的配置项。

再次格式化namenode，成功了:

**\[html\]** [view plain][] [copy][view plain]

1.  省略前面部分.... 
2.  16/10/26 18:41:32 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033 
3.  16/10/26 18:41:32 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0
4.  16/10/26 18:41:32 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000
5.  16/10/26 18:41:32 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10
6.  16/10/26 18:41:32 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10
7.  16/10/26 18:41:32 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 
8.  16/10/26 18:41:32 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 
9.  16/10/26 18:41:32 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 
10. 16/10/26 18:41:32 INFO util.GSet: Computing capacity for map NameNodeRetryCache 
11. 16/10/26 18:41:32 INFO util.GSet: VM type = 64\-bit 
12. 16/10/26 18:41:32 INFO util.GSet: 0.029999999329447746% max memory 966.7 MB = 297.0 KB 
13. 16/10/26 18:41:32 INFO util.GSet: capacity = 2^15 = 32768 entries 
14. 16/10/26 18:41:32 INFO namenode.FSImage: Allocated new BlockPoolId: BP-380982764-192.168.61.120-1477478492348 
15. 16/10/26 18:41:32 INFO common.Storage: Storage directory /data01/hadoop/dfs/name has been successfully formatted. 
16. 16/10/26 18:41:33 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 
17. 16/10/26 18:41:33 INFO util.ExitUtil: Exiting with status 0 
18. 16/10/26 18:41:33 INFO namenode.NameNode: SHUTDOWN\_MSG: 
19. /\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\* 
20. SHUTDOWN\_MSG: Shutting down NameNode at poseidon01/192.168.61.120 
21. \*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*/

[view plain]: https://blog.csdn.net/gua___gua/article/details/52937416#