Hadoop安装与伪分布式配置

比眉伴天荒 2023-07-24 08:44 15阅读 0赞

### 文章目录 ###

*  1.hadoop cdh下载地址
 *  2.下载
 *  3.解压
 *  4.添加环境变量
 *  5.配置Hadoop文件

# 1.hadoop cdh下载地址 #

[http://archive.cloudera.com/cdh5/cdh/5/][http_archive.cloudera.com_cdh5_cdh_5]

# 2.下载 #

wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.15.1.tar.gz

也可以scp传输文件

# 3.解压 #

tar -zxvf hadoop-2.6.0-cdh5.15.1.tar.gz -C ~/app/

# 4.添加环境变量 #

sudo vim /etc/profile   //所有用户添加
    export HADOOP_HOME=/home/ubuntu/app/hadoop-2.6.0-cdh5.15.1
    export PATH=$PATH:$HADOOP_HOME/bin

![20200411082730794.png_pic_center][]

source /etc/profile
    echo $HADOOP_HOME

![20200411082855617.png_pic_center][]

# 5.配置Hadoop文件 #

cd $HADOOP_HOME
    cd etc/hadoop
    vim hadoop-env.sh

![20200411083805387.png_pic_center][]  
导入**echo $JAVA\_HOME**的位置

export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64

![20200411084115901.png_pic_center][]  
**etc/hadoop/core-site.xml:**

vim core-site.xml

![20200411085528138.png_pic_center][]

<configuration>
        <property>
            <name>fs.defaultFS</name>
            <value>hdfs://localhost:9000</value>
        </property>
    </configuration>

**etc/hadoop/hdfs-site.xml:**

vim hdfs-site.xml

![20200411095010298.png_pic_center][]

**Reference**  
[https://ke.qq.com/course/478249][https_ke.qq.com_course_478249]

[http_archive.cloudera.com_cdh5_cdh_5]: http://archive.cloudera.com/cdh5/cdh/5/
[20200411082730794.png_pic_center]: /images/20230528/c994513f3e134504b9a97061856cd5b5.png
[20200411082855617.png_pic_center]: /images/20230528/41c90dd40c1640cbae5f59985981907a.png
[20200411083805387.png_pic_center]: /images/20230528/67985e880c7e48c288d7219e50b63ab5.png
[20200411084115901.png_pic_center]: /images/20230528/779f43eaf3064cc3885dcb1ffc252ca8.png
[20200411085528138.png_pic_center]: /images/20230528/78a8c8dd95f44e749278f780dd390342.png
[20200411095010298.png_pic_center]: /images/20230528/bdeab988b7514574b2c6969ec0c3e14f.png
[https_ke.qq.com_course_478249]: https://ke.qq.com/course/478249