Hadoop：Hadoop简介及环境配置

男娘i 2022-08-21 08:53 181阅读 0赞

http://[blog.csdn.net/pipisorry/article/details/51243805][blog.csdn.net_pipisorry_article_details_51243805]

# Hadoop简介 #

下次写上。。。[  
][Link 1]

[皮皮blog][Link 1]

## 配置hadoop环境可能出现的问题 ##

每次format之前最好删除掉保存的日志等文件，免得namenode和datanode的id不一致而出现问题。  
搭建完成后运行时候遇到过卡到map阶段不会动情况，然后配置了一下yarn内存可以用了。  
每次format之前最好删除掉保存的日志等文件，免得namenode和datanode的id不一致而出现问题。

![Center][]

## Eclipse中使用hadoop编程    ##

下载安装eclipse

root用户打开eclipse：

root@ubuntu-BDMS:~\# /opt/eclipse/eclipse &

下载配置hadoop的eclipse插件

下载hadoop-eclipse-plugin-2.6.0.jar到eclipse安装目录/plugins目录下\[[hadoop2x-eclipse-plugin][]\]

guest@ubuntu-BDMS:~$ sudo wget -P /opt/eclipse/plugins/ https://github.com/winghc/hadoop2x-eclipse-plugin/blob/master/release/hadoop-eclipse-plugin-2.6.0.jar

\[[Eclipse下搭建Hadoop2.4.0开发环境][Eclipse_Hadoop2.4.0]\]

\[[基于Eclipse的Hadoop应用开发环境配置][Eclipse_Hadoop]\]

\[[hadoop2.6.0的eclipse插件编译和设置][hadoop2.6.0_eclipse]\]

from: [http://blog.csdn.net/pipisorry/article/details/51243805][blog.csdn.net_pipisorry_article_details_51243805]

ref: [Hadoop文档][Hadoop]

\[[脱离JVM? Hadoop生态圈的挣扎与演化][JVM_ Hadoop]\]

[blog.csdn.net_pipisorry_article_details_51243805]: http://blog.csdn.net/pipisorry/article/details/51243805
[Link 1]: http://blog.csdn.net/pipisorry
[Center]: /images/20220724/a5f515ccf4ab409a8b42b24521e87801.png
[hadoop2x-eclipse-plugin]: https://github.com/winghc/hadoop2x-eclipse-plugin
[Eclipse_Hadoop2.4.0]: http://www.cnblogs.com/kinglau/p/3802705.html
[Eclipse_Hadoop]: http://www.cnblogs.com/flyoung2008/archive/2011/12/09/2281400.html
[hadoop2.6.0_eclipse]: http://blog.csdn.net/ggz631047367/article/details/42497557
[Hadoop]: http://hadoop.apache.org/docs/r1.0.4/cn/
[JVM_ Hadoop]: http://www.36dsj.com/archives/56237