hadoop伪分布式安装（VMware、Ubuntu）

深碍√TFBOYSˉ_ 2022-02-21 12:53 326阅读 0赞

主要参考：[https://blog.csdn.net/qq\_38270906/article/details/79916567][https_blog.csdn.net_qq_38270906_article_details_79916567]

后面又重新装了一次，有些文件夹对应不上：目前hadoop目录：/usr/local/hadoop/hadoop-2.7.5, java路径：/usr/local/jdk1.8.0\_201，而且用户名后来改成了hadoop，用的目录有点乱，但是顺序是差不多这样的。

ssh配置：先安装，再在普通用户下验证，ssh localhost 在root用户下出错：Permission denied, please try again.。最后设置免密登陆

![20190414113742731.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 1][]

1. 安装jdk，见[https://blog.csdn.net/suixuejie/article/details/89148677][https_blog.csdn.net_suixuejie_article_details_89148677]

2. 下载Hadoop[http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.7.5/hadoop-2.7.5.tar.gz][http_www.apache.org_dyn_closer.cgi_hadoop_common_hadoop-2.7.5_hadoop-2.7.5.tar.gz]到Windows文件夹下

3. 安装VMware-tools，方法见：[https://blog.csdn.net/suixuejie/article/details/89140077][https_blog.csdn.net_suixuejie_article_details_89140077]，将下载的Hadoop文件copy到linux桌面

4. root权限创建新用户

sudo    useradd    -m    hadoopuser    -s    /bin/bash

passed    hadoopuser

sudo    adduser    hadoopuser    sudo

5. 切换至hadoopuser，将下载的hadoop文件移至/home/hadoopuser中，并为hadoopuser授予权限

su    hadoopuser

mv    /home/sxj桌面/hadoop    /home/hadoopuser

cd    /home/hadoopuser

sudo    chown    -R    hadoopuser   ./hadoop

6. 更改配置

sudo    gedit    /etc/profile

source    /etc/profile

![20190410095906241.png][]

在最下面添加

![20190410095814989.png][]

进入etc文件夹下的hadoop中

sudo    gedit    hadoop-env.sh

![20190410100024306.png][]

更改Java路径

![201904101001583.png][]

更改HADOOP\_HOME

source    hadoop-env.sh

7. 查看hadoop是否安装成功时，一直出错，改了半天，才找到解决方法，错误信息如下：

![20190410100359882.png][]

解决方法：

![20190410100625840.png][]

![20190410100602616.png][]

8. 更改配置

sudo edit    core-site.xml

![20190414171516278.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 2][]

sudo  edit    hdfs-site.xml

![20190414171559250.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 3][]

sudo  edit  mapred-site.xml.template

![20190414171737544.png][]

![20190414171715962.png][]

sudo  edit  yarn-site.xml

![20190414171848247.png][]

![20190414171822429.png][]

9.namenode格式化，Exiting withstatus 0表示格式化成功，只能格式化一次

![20190410104409583.png][]

![20190410104444827.png][]

9.启动进程，输入：./sbin/start-dfs.sh

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 4][]

10. jps验证，这里出错啦！jps命令不存在

![20190410224153329.png][]

解决方法：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 5][]

安装完成后再一次jps,成功！

![20190410224409246.png][]

11.查看网页信息：localhost:9000，但是出错

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 6][]

解决：因为设置单节点的原因，所以应该输入：[http://localhost:8088/cluster][http_localhost_8088_cluster] 成功！

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 7][]

[https_blog.csdn.net_qq_38270906_article_details_79916567]: https://blog.csdn.net/qq_38270906/article/details/79916567
[20190414113742731.png]: /images/20220221/d43970fbbf5d44ea9b14bb98b56992de.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70]: /images/20220221/4c85fd5cb8bc4864b54fbb45fff19008.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 1]: /images/20220221/0e439d2801de481b82e5722d375edafd.png
[https_blog.csdn.net_suixuejie_article_details_89148677]: https://blog.csdn.net/suixuejie/article/details/89148677
[http_www.apache.org_dyn_closer.cgi_hadoop_common_hadoop-2.7.5_hadoop-2.7.5.tar.gz]: http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.7.5/hadoop-2.7.5.tar.gz
[https_blog.csdn.net_suixuejie_article_details_89140077]: https://blog.csdn.net/suixuejie/article/details/89140077
[20190410095906241.png]: /images/20220221/6e3f54398c084395a0f707e69e70b64c.png
[20190410095814989.png]: /images/20220221/14267f3f5ec1444c9937d993fcea3ebb.png
[20190410100024306.png]: /images/20220221/236c25d8dc8248278b169c8d16962218.png
[201904101001583.png]: /images/20220221/bee8f8d7b20f486b858f2bb54c60f43b.png
[20190410100359882.png]: /images/20220221/43072a13eb154ec588d00ca6813abc86.png
[20190410100625840.png]: /images/20220221/73a506a28ec84007b32dd9830fbb1a9e.png
[20190410100602616.png]: /images/20220221/378358fd85ba4985b204ea0c6cdf893c.png
[20190414171516278.png]: /images/20220221/7269ee16a8934cf2b6cc450abbf094a4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 2]: /images/20220221/5c03f9f43e784d33b713993b0790facf.png
[20190414171559250.png]: /images/20220221/07aee307e37c4bd7af53f2e71511d7b4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 3]: /images/20220221/c1096f465c6b476686941ea54ba0472a.png
[20190414171737544.png]: /images/20220221/965d8f3b7d5c4bb4990a8fcd124dc105.png
[20190414171715962.png]: /images/20220221/bf5ed1ee2cd14aaea8dc386657f4b7de.png
[20190414171848247.png]: /images/20220221/05f3b01f0511430fa354d66fff53d9d1.png
[20190414171822429.png]: /images/20220221/19902d98572146b997f4a27c40b09674.png
[20190410104409583.png]: /images/20220221/ad8132928e174d08bfc8a1e0f3b40e13.png
[20190410104444827.png]: /images/20220221/5424fc15a8ba45a28afd663f7526cd7d.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 4]: /images/20220221/e3681d33af304f47831b3a0a7d88cf31.png
[20190410224153329.png]: /images/20220221/5bd41e847cef488a905f6784b8ed939d.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 5]: /images/20220221/13a1a6c91e8344578eed9586de7786ea.png
[20190410224409246.png]: /images/20220221/26e1ada5504d4f02ad11e3afe2dbd05e.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 6]: /images/20220221/8960ec413d4146bd981eb78cf570189a.png
[http_localhost_8088_cluster]: http://localhost:8088/cluster
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3N1aXh1ZWppZQ_size_16_color_FFFFFF_t_70 7]: /images/20220221/71e707f551364d6993987b63ed02b6bb.png