LVS+Keepalived高可用群集

墨蓝 2023-10-05 15:18 38阅读 0赞

#### 文章目录 ####

*  一、Keepalived简介
 *   *  1.1 Keepalived工具
     *  1.2 Keepalived工作原理
 *  二、Keepalived安装和启动
 *  三、搭建LVS+Keepalived高可用群集
 *   *  3.1 环境
     *  3.2 配置主LVS+Keepalived调度器
     *  3.3 配置从 LVS+Keepalived调度器
     *   *  配置过程与主调度器基本相同，只有几处需要修改
 *  四、测试查看效果
 *   *  4.1 测试 查看VIP LVS虚拟服务器，日志
     *   *  从调度器不显示VIP（192.168.100.200）

[lvs+nginx负载均衡参考][lvs_nginx]

## 一、Keepalived简介 ##

### 1.1 Keepalived工具 ###

Keepalived（高可用）起初是专门针对LVS设计的辅助工具，它的两个强大功能：

*  故障切换（Failover）
 *  健康检查（Health Checking）  
    判断LVS负载调度器、节点服务器的可用性，并及时隔离和替换新的服务器节点。当故障主机恢复后将其重新加入群集。
 *  在非LVS群集环境中使用时，keepalived也可以作为热备软件使用。如：Keepalived+haproxy、Keepalived+nginx等

### 1.2 Keepalived工作原理 ###

*  Keepalived采用VRRP（virtual router redundance protocol)实现Linux服务器的多机热备功能
 *  VRRP，虚拟路由冗余协议，是针对路由器的一种备份解决方案

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw_size_1_color_FFFFFF_t_70]

多台路由器组成一个热备组，通过共用的虚拟IP地址对外提供服务。  
每个热备组内同一时刻只有一台主路由器提供服务，其他路由器处于冗余状态。  
若当前在线的路由器失效，则其他路由器会根据设置的优先级自动接替虚拟IP地址，继续提供服务。

## 二、Keepalived安装和启动 ##

1.  编译安装Keepalived

tar zxvf keepalived-1.4.2.tar.gz   //解压
    cd keepalived-1.4.2/
    ./configure --prefix=/      //配置
    make && make install

1.  Keepalived 加入系统管理

cp keepalived/etc/init.d/keepalived /etc/init.d/       //加入系统管理服务
    systemctl enable keepalived      //设置开机自启，可以不设置，

## 三、搭建LVS+Keepalived高可用群集 ##

### 3.1 环境 ###

两台调度器                         漂移地址：192.168.100.200
    ip：192.168.100.10              // 主
    ip：192.168.100.11              //从
    两台web服务器构成的server pool
    ip：192.168.100.12
    ip：192.168.100.13
    nfs服务器
    ip：192.168.100.14
    客户端 
     ip 192.168.100.15

### 3.2 配置主LVS+Keepalived调度器 ###

1.  加载ip\_vs模块

modprobe ip_vs     //加载ip_vs模块

*  查看ip\_vs模块

[root@server1 yum.repos.d]# cat /proc/net/ip_vs
    IP Virtual Server version 1.2.1 (size=4096)
    Prot LocalAddress:Port Scheduler Flags
      -> RemoteAddress:Port Forward Weight ActiveConn InActConn

yum -y install ipvsadm //ipvsadm管理软件  
yum -y install gcc gcc-c++ make popt-devel kernel-devel openssl-devel //编译安装Keepalived所需环境

2. 编译安装
    ```java
    tar zxvf keepalived-1.4.2.tar.gz   //解压
    cd keepalived-1.4.2/
    ./configure --prefix=/      //配置
    make && make install 
    cp keepalived/etc/init.d/keepalived /etc/init.d/       //加入系统管理服务
    systemctl enable keepalived      //设置开机自启，可以不设置，自己看

1.  编辑配置文件

vim /etc/keepalived/keepalived.conf 
    ！Configuration File for keepalived
    global_defs {
                     //全局设置
      router_id LVS_01     //服务器名称
    }
    vrrp_instance VI_1 {
                 //vrrp instance
      state MASTER         //热备状态，MASTER主服务器，BACKUP从服务器
      interface ens33      //承载VIP地址的物理接口
      virtual_router_id 51    //虚拟路由器的ID号，每个热备组保持一致
      priority 110              //优先级，数值越大越优先
      advert_int 1             //advert interval  通告间隔（心跳频率）
      authentication {
        
        auth_type PASS   //认证类型
        auth_pass 1111    //认证密码
      }
      virtual_ipaddress {
                  //指定漂移地址，可以有多个
        192.168.100.200
      }
    }
    virtual_server 192.168.100.200 80{
                     //虚拟服务器地址（VIP）、端口
    	delay_loop 6              //健康检查的时间间隔（秒）
    	lb_algo rr        //load-balance_logorithm RoundRobin 负载均衡算法 轮询
    	lb_kind DR      //负载均衡种类 DR工作模式
    	persistence_timeout 6     //连接保持时间
    	protocol TCP             //连接协议 TCP
      real_server 192.168.100.12 80 {
                   服务器节点真实地址
    	weight 1     //权重
    	TCP_CHECK {
                       //健康检查
    	  connect_port 80
    	  connect_timeout 3         //连接超时
    	  nb_get_retry 3            //重试次数
    	  delay_before_retry 3     //重试间隔
    	}
      }
      real_server 192.168.100.13 80 {
                //第二个服务器节点真实地址
    	weight 1
    	TCP_CHECK {
        
    	  connect_port 80
    	  connect_timeout 3
    	  nb_get_retry 3
    	  delay_before_retry 3
    	}
      }
    }
    :wq

1.  启动keepalived

cp keepalived/etc/init.d/keepalived /etc/init.d/
    systemctl start keepalived

### 3.3 配置从 LVS+Keepalived调度器 ###

#### 配置过程与主调度器基本相同，只有几处需要修改 ####

global_defs {
        
      router_id LVS_02      //第一处
    }
    vrrp_instance VI_1 {
        
      state BACKUP           //第二处
      ......
      priority    105      //第三处
    }
    :wq

## 四、测试查看效果 ##

server pool的web1 web2 还有nfs共享存储的搭建就不再赘述，，  
我们使用192.168.100.15客户端来测试

### 4.1 测试 查看VIP LVS虚拟服务器，日志 ###

ip addr show dev ens33    //验证绑定了的虚拟地址

主调度器效果  
![在这里插入图片描述][20201209231020416.png]

从调度器效果  
![在这里插入图片描述][20201209231417249.jpg]

#### 从调度器不显示VIP（192.168.100.200） ####

ipvsadm -Ln              //查看LVS虚拟服务器

主调度器  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw_size_1_color_FFFFFF_t_70 1]  
从调度器  
![在这里插入图片描述][20201209231845779.png]  
可以看出从调度器没有使用。

tail -f /var/log/messages        //动态查看日志（状态时）

关闭主调度器上的ens33网卡，这时候我们查看从服务器的日志，可以看出：调度器的状态从BACKUP边成了MASTER，说明配置成功。

[root@server2 ~]# tail -30 /var/log/messages 
    Dec  9 23:28:10 localhost Keepalived_healthcheckers[66819]: Gained quorum 1+0=1 <= 2 for VS [192.168.100.200]:tcp:80
    Dec  9 23:28:10 localhost Keepalived_healthcheckers[66819]: Activating healthchecker for service [192.168.100.12]:tcp:80 for VS [192.168.100.200]:tcp:80
    Dec  9 23:28:10 localhost Keepalived_healthcheckers[66819]: Activating healthchecker for service [192.168.100.13]:tcp:80 for VS [192.168.100.200]:tcp:80
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Registering Kernel netlink reflector
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Registering Kernel netlink command channel
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Opening file '/etc/keepalived/keepalived.conf'.
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Assigned address 192.168.100.11 for interface ens33
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Assigned address fe80::2174:4644:e60a:da19 for interface ens33
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: Registering gratuitous ARP shared channel
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: (VI_1) removing VIPs.
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: (VI_1) Entering BACKUP STATE (init)
    Dec  9 23:28:10 localhost Keepalived_vrrp[66820]: VRRP sockpool: [ifindex(2), family(IPv4), proto(112), unicast(0), fd(11,12)]
    Dec  9 23:28:13 localhost Keepalived_healthcheckers[66819]: TCP connection to [192.168.100.13]:tcp:80 success.
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: (VI_1) Receive advertisement timeout
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: (VI_1) Entering MASTER STATE
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: (VI_1) setting VIPs.
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: (VI_1) Sending/queueing gratuitous ARPs on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:14 localhost avahi-daemon[609]: Registering new address record for 192.168.100.200 on ens33.IPv4.
    Dec  9 23:28:16 localhost Keepalived_healthcheckers[66819]: TCP connection to [192.168.100.12]:tcp:80 success.
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: (VI_1) Sending/queueing gratuitous ARPs on ens33 for 192.168.100.200
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200
    Dec  9 23:28:19 localhost Keepalived_vrrp[66820]: Sending gratuitous ARP on ens33 for 192.168.100.200

[lvs_nginx]: https://www.cnblogs.com/arjenlee/p/9262737.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw_size_1_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20201209114823113.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw,size_1,color_FFFFFF,t_70
[20201209231020416.png]: https://img-blog.csdnimg.cn/20201209231020416.png
[20201209231417249.jpg]: https://img-blog.csdnimg.cn/20201209231417249.jpg
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw_size_1_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20201209201331674.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ2NDgwMDIw,size_1,color_FFFFFF,t_70
[20201209231845779.png]: https://img-blog.csdnimg.cn/20201209231845779.png