Hadoop 3.1.3的安装部署(HA)

「爱情、让人受尽委屈。」 2022-12-15 14:02 157阅读 0赞

### 目录 ###

*   *  HDFS HA搭建
     *  ResouceManager HA搭建
     *  启动集群

## HDFS HA搭建 ##

（1）上传压缩包到software文件夹，并进行解压

[root@hadoop202 servers]# cd /export/software/
    [root@hadoop202 software]# tar -zxvf hadoop-3.1.3.tar.gz -C /export/servers/

（2）分发export目录下hadoop文件夹

[root@hadoop202 software]# cd /export/servers/
    [root@hadoop202 servers]# scp -r hadoop-3.1.3/ hadoop203:/export/servers/
    [root@hadoop202 servers]# scp -r hadoop-3.1.3/ hadoop204:/export/servers/

（3）配置hadoop环境变量，结尾处加上hadoop路径，其余两台机器同样操作

[root@hadoop202 hadoop-3.1.3]# vim /etc/profile
    #HADOOP_HOME
    export HADOOP_HOME=/export/servers/hadoop-3.1.3
    export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
    [root@hadoop202 hadoop-3.1.3]# source /etc/profile
    [root@hadoop202 hadoop-3.1.3]# hadoop version
    Hadoop 3.1.3
    Source code repository https://gitbox.apache.org/repos/asf/hadoop.git -r ba631c436b806728f8ec2f54ab1e289526c90579
    Compiled by ztang on 2019-09-12T02:47Z
    Compiled with protoc 2.5.0
    From source with checksum ec785077c385118ac91aadde5ec9799
    This command was run using /export/servers/hadoop-3.1.3/share/hadoop/common/hadoop-common-3.1.3.jar

（4）配置nameservice，编写hdfs-sitx.xml

[root@hadoop202 hadoop-3.1.3]# cd etc/hadoop/
    [root@hadoop202 hadoop]# vim hdfs-site.xml 
    <configuration>
    
    <property>
                    <name>dfs.replication</name>
                    <value>1</value>
    </property>
    
    <property>
      <name>dfs.nameservices</name>
      <value>mycluster</value>
    </property>
    
    <property>
      <name>dfs.ha.namenodes.mycluster</name>
      <value>nn1,nn2,nn3</value>
    </property>
    <property>
      <name>dfs.namenode.rpc-address.mycluster.nn1</name>
      <value>hadoop202:8020</value>
    </property>
    <property>
      <name>dfs.namenode.rpc-address.mycluster.nn2</name>
      <value>hadoop203:8020</value>
    </property>
    <property>
      <name>dfs.namenode.rpc-address.mycluster.nn3</name>
      <value>hadoop204:8020</value>
    </property>
    
    
    <property>
      <name>dfs.namenode.http-address.mycluster.nn1</name>
      <value>hadoop202:9870</value>
    </property>
    <property>
      <name>dfs.namenode.http-address.mycluster.nn2</name>
      <value>hadoop203:9870</value>
    </property>
    <property>
      <name>dfs.namenode.http-address.mycluster.nn3</name>
      <value>hadoop204:9870</value>
    </property>
    
    
    <property>
      <name>dfs.namenode.shared.edits.dir</name>
      <value>qjournal://hadoop202:8485;hadoop203:8485;hadoop204:8485/mycluster</value>
    </property>
    
    
    <property>
      <name>dfs.client.failover.proxy.provider.mycluster</name>
      <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
    </property>
    
     
            <property>
                    <name>dfs.ha.fencing.methods</name>
                    <value>sshfence</value>
            </property>
    
    
            <property>
             <name>dfs.ha.fencing.ssh.private-key-files</name>
            <value>/root/.ssh/id_rsa</value>
            </property>
    
    
            <property>
                    <name>dfs.permissions.enable</name>
                    <value>false</value>
            </property>
    
    </configuration>

（5）编写core-site.xml

<configuration>  
    
     <property>
      <name>fs.defaultFS</name>
      <value>hdfs://mycluster</value>
    </property>
    
     
      <property>
      <name>dfs.journalnode.edits.dir</name>
      <value>/export/servers/hadoop-3.1.3/JN/data</value>
      </property>
      
      <property>
      <name>hadoop.tmp.dir</name>
      <value>/export/servers/hadoop-3.1.3/tmp</value>
     </property>
    </configuration>

（6）在hdfs.xml添加故障自动转移

[root@hadoop202 hadoop]# vim hdfs-site.xml 
    
     <property>
       <name>dfs.ha.automatic-failover.enabled</name>
       <value>true</value>
     </property>

（7）在core-site.xml添加zookeeper地址

<property>
       <name>ha.zookeeper.quorum</name>
       <value>hadoop202:2181,hadoop203:2181,hadoop204:2181</value>
     </property>

## ResouceManager HA搭建 ##

（1）编写yarn-site.xml

[root@hadoop202 hadoop]# vim yarn-site.xml 
    
     <property>
            <name>yarn.nodemanager.aux-services</name>
            <value>mapreduce_shuffle</value>
        </property>
    <property>
      <name>yarn.resourcemanager.ha.enabled</name>
      <value>true</value>
    </property>
    <property>
      <name>yarn.resourcemanager.cluster-id</name>
      <value>cluster1</value>
    </property>
    <property>
      <name>yarn.resourcemanager.ha.rm-ids</name>
      <value>rm1,rm2</value>
    </property>
    <property>
      <name>yarn.resourcemanager.hostname.rm1</name>
      <value>hadoop202</value>
    </property>
    <property>
      <name>yarn.resourcemanager.hostname.rm2</name>
      <value>hadoop204</value>
    </property>
    <property>
      <name>yarn.resourcemanager.webapp.address.rm1</name>
      <value>hadoop202:8088</value>
    </property>
    <property>
      <name>yarn.resourcemanager.webapp.address.rm2</name>
      <value>hadoop204:8088</value>
    </property>
    <property>
      <name>hadoop.zk.address</name>
      <value>hadoop202:2181,hadoop203:2181,hadoop204:2181</value>
    </property>
     
        <property>
            <name>yarn.resourcemanager.recovery.enabled</name>
            <value>true</value>
    </property>
    
    
     <property>
         <name>yarn.resourcemanager.store.class</name>     
       <value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>
    </property>

## 启动集群 ##

（1）配置workers(老版本为slaves)

[root@hadoop202 hadoop]# vim workers
    hadoop202
    hadoop203
    Hadoop204

（2）分发配置文件

[root@hadoop202 hadoop]# cd ..
    [root@hadoop202 etc]# scp -r hadoop/ hadoop203:/export/servers/hadoop-3.1.3/etc/
    [root@hadoop202 etc]# scp -r hadoop/ hadoop204:/export/servers/hadoop-3.1.3/etc/

（3）在各台机器上启动journalnode服务

[root@hadoop202 hadoop-3.1.3]# sbin/hadoop-daemon.sh start journalnode
    [root@hadoop203 hadoop-3.1.3]# sbin/hadoop-daemon.sh start journalnode
    [root@hadoop204 hadoop-3.1.3]# sbin/hadoop-daemon.sh start journalnode

（4）在nn1上对namenode进行格式化

[root@hadoop202 hadoop-3.1.3]# bin/hdfs namenode -format

（5）在start-dfs.sh,stop-dfs.sh中配置root用户,顶部配置以下内容

[root@hadoop202 hadoop-3.1.3]# vim sbin/start-dfs.sh
    HDFS_DATANODE_USER=root
    HADOOP_SECURE_DN_USER=hdfs
    HDFS_NAMENODE_USER=root
    HDFS_SECONDARYNAMENODE_USER=root
    HDFS_JOURNALNODE_USER=root
    HDFS_ZKFC_USER=root
    [root@hadoop202 hadoop-3.1.3]# vim sbin/stop-dfs.sh
    HDFS_DATANODE_USER=root
    HADOOP_SECURE_DN_USER=hdfs
    HDFS_NAMENODE_USER=root
    HDFS_SECONDARYNAMENODE_USER=root
    HDFS_JOURNALNODE_USER=root
    HDFS_ZKFC_USER=root

（6）在start-yarn.sh,stop-yarn.sh中配置root用户,顶部配置以下内容

[root@hadoop202 hadoop-3.1.3]# vim sbin/start-yarn.sh
    YARN_RESOURCEMANAGER_USER=root
    HADOOP_SECURE_DN_USER=yarn
    YARN_NODEMANAGER_USER=root
    [root@hadoop202 hadoop-3.1.3]# vim sbin/stop-yarn.sh
    YARN_RESOURCEMANAGER_USER=root
    HADOOP_SECURE_DN_USER=yarn
    YARN_NODEMANAGER_USER=root

（7）编辑hadoop-env.sh,解开注释，添加JAVA\_HOME

[root@hadoop202 hadoop-3.1.3]# vim etc/hadoop/hadoop-env.sh 
    export JAVA_HOME=/export/servers/jdk1.8.0_211
    [root@hadoop203 hadoop-3.1.3]# vim etc/hadoop/hadoop-env.sh 
    export JAVA_HOME=/export/servers/jdk1.8.0_211
    [root@hadoop204 hadoop-3.1.3]# vim etc/hadoop/hadoop-env.sh 
    export JAVA_HOME=/export/servers/jdk1.8.0_211

（8）分发以上.sh文件

[root@hadoop202 hadoop-3.1.3]# scp -r sbin/ hadoop203:/export/servers/hadoop-3.1.3/
    [root@hadoop202 hadoop-3.1.3]# scp -r sbin/ hadoop204:/export/servers/hadoop-3.1.3/

（9）同步,启动nn1的namenode，在 nn2和nn3上进行同步

[root@hadoop202 hadoop-3.1.3]# sbin/hadoop-daemon.sh start namenode
    [root@hadoop203 hadoop-3.1.3]# bin/hdfs namenode -bootstrapStandby
    [root@hadoop204 hadoop-3.1.3]# bin/hdfs namenode -bootstrapStandby
    [root@hadoop203 hadoop-3.1.3]# sbin/hadoop-daemon.sh start namenode
    [root@hadoop203 hadoop-3.1.3]# sbin/hadoop-daemon.sh start namenode

（10）关闭所有hdfs服务

[root@hadoop202 hadoop-3.1.3]# sbin/stop-all.sh

（11）初始化HA在Zookeeper中状态：

[root@hadoop202 hadoop-3.1.3]# bin/hdfs zkfc -formatZK

（12）启动集群服务

[root@hadoop202 hadoop-3.1.3]# sbin/start-all.sh

登入网页  
[http://hadoop202:9870/dfshealth.html\#tab-overview][http_hadoop202_9870_dfshealth.html_tab-overview]

[http_hadoop202_9870_dfshealth.html_tab-overview]: http://hadoop202:9870/dfshealth.html#tab-overview