redis集群之新增节点

缺乏、安全感 2022-06-08 13:39 190阅读 0赞

#### 操作环境 ####

服务器centos7.3, ip:47.52.41.245，所包含的集群节点有7003,7004,7005

#### 查看所有节点信息 ####

1.  没有密码情况下

redis-cli -c -p port cluster nodes

port：端口

1.  有密码情况下

redis-cli -c -p port -a password cluster nodes

password:密码

port 是本服务器集群中任意节点的端口

[root@iZj6c7eeosj2t5vjw8rf4xZ /]# redis-cli -c -p 7003 cluster nodes
    668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506343504317 2 connected 10923-16383
    908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 15063435093
    33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506343506319 1 connected 0-5460
    cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922
    3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506343507275
    ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506343508277

#### 新增节点 ####

1.  在先前已经搭建好集群的服务器47.52.41.245上面的/tmp/frank/redis/redis-3.2.1/redis\_cluster下面新建一个文件夹7006,然后把7003下redis.config拷贝里面

[root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd /tmp/frank/redis/redis-3.2.1/redis_cluster/
    [root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# ls
    7003  7004  7005
    [root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# mkdir 7006
    [root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cp /tmp/frank/redis/redis-3.2.1/redis_cluster/7003/redis.conf 7006
    [root@iZj6c7eeosj2t5vjw8rf4xZ redis_cluster]# cd 7006
    [root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# ls
    redis.conf

1.  修改redis.config,修改内容如下

port  7006                      //端口 
    protected-mode no   //关掉保护模式3.2之后 不然会报Sorry, can't connect to node
    #bind 本机ip //默认ip为127.0.0.1，在3.2之后要注释掉 daemonize yes //redis后台运行
    pidfile  /var/run/redis_7006.pid//pidfile文件对应7006
    cluster-enabled  yes            //开启集群 把注释#去掉
    cluster-config-file  nodes_7006.conf//集群的配置 配置文件首次启动自动生成 7006
    cluster-node-timeout  15000     //请求超时 默认15秒，可自行设置
    appendonly  yes             //aof日志开启

1.  开放服务器和安全组的7006和17006（集群对应的）端口,先启动防火墙，然后开发对应端口，接着重庆防火墙，如果有安全组，安全组同样要开启

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# systemctl start firewalld.service
    [root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=7006/tcp --permanent
    success
    [root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --zone=public --add-port=17006/tcp --permanent
    success
    [root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# firewall-cmd --reload
    success

4.启动节点并查看启动状态

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-server redis.conf 
    [root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# netstat -tnlp | grep redis
    tcp        0      0 0.0.0.0:17003           0.0.0.0:*               LISTEN      2228/redis-server * 
    tcp        0      0 0.0.0.0:17004           0.0.0.0:*               LISTEN      2224/redis-server * 
    tcp        0      0 0.0.0.0:17005           0.0.0.0:*               LISTEN      2232/redis-server * 
    tcp        0      0 0.0.0.0:17006           0.0.0.0:*               LISTEN      3867/redis-server * 
    tcp        0      0 0.0.0.0:7003            0.0.0.0:*               LISTEN      2228/redis-server * 
    tcp        0      0 0.0.0.0:7004            0.0.0.0:*               LISTEN      2224/redis-server * 
    tcp        0      0 0.0.0.0:7005            0.0.0.0:*               LISTEN      2232/redis-server * 
    tcp        0      0 0.0.0.0:7006            0.0.0.0:*               LISTEN      3867/redis-server * 
    tcp6       0      0 :::17003                :::*                    LISTEN      2228/redis-server * 
    tcp6       0      0 :::17004                :::*                    LISTEN      2224/redis-server * 
    tcp6       0      0 :::17005                :::*                    LISTEN      2232/redis-server * 
    tcp6       0      0 :::17006                :::*                    LISTEN      3867/redis-server * 
    tcp6       0      0 :::7003                 :::*                    LISTEN      2228/redis-server * 
    tcp6       0      0 :::7004                 :::*                    LISTEN      2224/redis-server * 
    tcp6       0      0 :::7005                 :::*                    LISTEN      2232/redis-server * 
    tcp6       0      0 :::7006                 :::*                    LISTEN      3867/redis-server *

1.  将新节点加入到集群

执行 redis-trib.rb add-node host:port host1:port1

host:port:为新节点的主机和端口

host1:port1：为集群里面的某个节点主机和端口

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-trib.rb add-node 47.52.41.245:7006 47.52.41.245:7003
    >>> Adding node 47.52.41.245:7006 to cluster 47.52.41.245:7003
    >>> Performing Cluster Check (using node 47.52.41.245:7003)
    M: cc86a24f3896ad7530e2687cf52582912f74b661 47.52.41.245:7003
       slots:5461-10922 (5462 slots) master
       1 additional replica(s)
    M: 668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001
       slots:10923-16383 (5461 slots) master
       1 additional replica(s)
    S: 908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002
       slots: (0 slots) slave
       replicates cc86a24f3896ad7530e2687cf52582912f74b661
    M: 33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000
       slots:0-5460 (5461 slots) master
       1 additional replica(s)
    S: 3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004
       slots: (0 slots) slave
       replicates 33d50636b5235de9970de2da75901b642d2b14d2
    S: ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005
       slots: (0 slots) slave
       replicates 668397aba571ece85532b1eb1fccb42e4e33b1f2
    [OK] All nodes agree about slots configuration.
    >>> Check for open slots...
    [WARNING] Node 116.196.65.198:7001 has slots in importing state (5598,8235).
    [WARNING] Node 116.196.65.198:7000 has slots in importing state (5598,8235).
    [WARNING] The following slots are open: 5598,8235
    >>> Check slots coverage...
    [OK] All 16384 slots covered.
    >>> Send CLUSTER MEET to node 47.52.41.245:7006 to make it join the cluster.
    [OK] New node added correctly.

1.  查看新增节点

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-cli -c -p 7003 cluster nodes
    668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506345812199 2 connected 10923-16383
    908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506345808190 4 connected
    33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506345811199 1 connected 0-5460
    cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5461-10922
    f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506345807145 0 connected
    3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506345809150 5 connected
    ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506345809651 6 connected

1.  增加了新的节点之后，这个新的节点可以成为主节点或者是从节点

把这个节点变成主节点，使用redis-trib程序，将集群中的某些哈希槽移动到新节点里面， 这个新节点就成为真正的主节点了。  
执行下面的命令对集群中的哈希槽进行移动

cd /usr/local/redis3.0/src
    ./redis-trib.rb reshard 47.52.41.245:7003

执行过程中系统会提示我们要移动多少哈希槽，这里移动1000个，然后我们就输入1000.接着会问你需要指定把这些哈希槽转移到哪个节点上，然后输入我们新增的节点id f38c5163523a5040372f58b95cd184c601fd9388，紧接着会问需要从哪几个节点转移，输入all就行了，由redis集群自己分配，然后再输入yes就OK了。然后查看一下节点状态

[root@iZj6c7eeosj2t5vjw8rf4xZ 7006]# redis-cli -c -p 7003 cluster nodes
    668397aba571ece85532b1eb1fccb42e4e33b1f2 116.196.65.198:7001 master - 0 1506349557418 2 connected 10923-16383
    908430b2bf63669898e9eaef79dd6c1b33c8c57a 116.196.65.198:7002 slave cc86a24f3896ad7530e2687cf52582912f74b661 0 1506349558418 4 connected
    33d50636b5235de9970de2da75901b642d2b14d2 116.196.65.198:7000 master - 0 1506349555415 1 connected 0-5460
    cc86a24f3896ad7530e2687cf52582912f74b661 172.31.195.1:7003 myself,master - 0 0 4 connected 5598-10922 [5598->-f38c5163523a5040372f58b95cd184c601fd9388]
    f38c5163523a5040372f58b95cd184c601fd9388 47.52.41.245:7006 master - 0 1506349556372 7 connected 5461-5597
    3a0b27e2e34e72430ce41bb78f6d207579175306 47.52.41.245:7004 slave 33d50636b5235de9970de2da75901b642d2b14d2 0 1506349553367 5 connected
    ca60de73e15c19a9aa45da508d270a5781a76724 47.52.41.245:7005 slave 668397aba571ece85532b1eb1fccb42e4e33b1f2 0 1506349558876 6 connected

已经有了插槽

1.  如果想要把新节点变成某个节点的从节点执行如下命令，前提新节点还没有分配哈希槽

redis-cli -c -p 7006 cluster replicate 33d50636b5235de9970de2da75901b642d2b14d2

33d50636b5235de9970de2da75901b642d2b14d2  
为某个主节点的id。

通过如下命令查看是否成功

redis-cli -p 7000 cluster nodes | grep slave | grep 33d50636b5235de9970de2da75901b642d2b14d2

7000为主节点的端口，33d50636b5235de9970de2da75901b642d2b14d2为主节点的id

1.  可能出现问题

ERR] Nodes don't agree about configuration!
    >>> Check for open slots...
    [WARNING] Node 116.196.65.198:7000 has slots in importing state (5608).
    [WARNING] The following slots are open: 5608

可以通过如下命令解决

#先连接集群
    redis-cli -h 116.196.65.198 -c -p 7000
    #然后输入
    cluster setslot 5608 stable
    
    #或者通过
    redis-trib.rb fix 116.196.65.198:7000