redis集群主从复制、哨兵模式、cluster模式

短命女 2022-12-30 13:34 355阅读 0赞

redis集群的三种模式

转载于： https://blog.csdn.net/miss1181248983/article/details/90056960

  1. * 主从模式    master挂掉后，就不能继续为外部提供服务
  3. * Sentinel模式  哨兵模式
  5. * Cluster模式

sentinel 哨兵模式的特点：

  1. * sentinel模式是建立在主从模式的基础上，如果只有一个Redis节点，sentinel就没有任何意义
  3. * 当master挂了以后，sentinel会在slave中选择一个做为master，并修改它们的配置文件，其他slave的配置文件也会被修改，比如slaveof属性会指向新的master
  5. * 当master重新启动后，它将不再是master而是做为slave接收新的master的同步数据
  7. * sentinel因为也是一个进程有挂掉的可能，所以sentinel也会启动多个形成一个sentinel集群
  9. * 多sentinel配置的时候，sentinel之间也会自动监控
  11. * 当主从模式配置密码时，sentinel也会同步将配置信息修改到配置文件中，不需要担心
  13. * 一个sentinel或sentinel集群可以管理多个主从Redis，多个sentinel也可以监控同一个redis
  15. * sentinel最好不要和Redis部署在同一台机器，不然Redis的服务器挂了以后，sentinel也挂了

工作机制：

  1. * 每个sentinel以每秒钟一次的频率向它所知的master，slave以及其他sentinel实例发送一个 PING 命令 
  3. * 如果一个实例距离最后一次有效回复 PING 命令的时间超过 down-after-milliseconds 选项所指定的值， 则这个实例会被sentinel标记为主观下线。 
  5. * 如果一个master被标记为主观下线，则正在监视这个master的所有sentinel要以每秒一次的频率确认master的确进入了主观下线状态
  7. * 当有足够数量的sentinel（大于等于配置文件指定的值）在指定的时间范围内确认master的确进入了主观下线状态， 则master会被标记为客观下线 
  9. * 在一般情况下， 每个sentinel会以每 10 秒一次的频率向它已知的所有master，slave发送 INFO 命令 
  11. * 当master被sentinel标记为客观下线时，sentinel向下线的master的所有slave发送 INFO 命令的频率会从 10 秒一次改为 1 秒一次 
  13. * 若没有足够数量的sentinel同意master已经下线，master的客观下线状态就会被移除；
  14.   若master重新向sentinel的 PING 命令返回有效回复，master的主观下线状态就会被移除

cluster模式

sentinel模式基本可以满足一般生产的需求，具备高可用性。但是当数据量过大到一台服务器存放不下的情况时，主从模式或sentinel模式就不能满足需求了，这个时候需要对存储的数据进行分片，将数据存储到多个Redis实例中。cluster模式的出现就是为了解决单机Redis容量有限的问题，将Redis的数据根据一定的规则分配到多台机器。

cluster可以说是sentinel和主从模式的结合体，通过cluster可以实现主从和master重选功能，所以如果配置两个副本三个分片的话，就需要六个Redis实例。因为Redis的数据是根据一定规则分配到cluster的不同机器的，当数据量过大时，可以新增机器进行扩容。

使用集群，只需要将redis配置文件中的cluster-enable配置打开即可。每个集群中至少需要三个主数据库才能正常运行，新增节点非常方便。

  1. * 多个redis节点网络互联，数据共享
  3. * 所有的节点都是一主一从（也可以是一主多从），其中从不提供服务，仅作为备用
  5. * 不支持同时处理多个key（如MSET/MGET），因为redis需要把key均匀分布在各个节点上，
  6.   并发量很高的情况下同时创建key-value会降低性能并导致不可预测的行为
  8. * 支持在线增加、删除节点
  10. * 客户端可以连接任何一个主节点进行读写

三台机器，分别开启两个redis服务（端口）

192.168.30.128 端口：7001,7002

192.168.30.129 端口：7003,7004

192.168.30.130 端口：7005,7006

配置文件：

192.168.30.128

  1. # mkdir /usr/local/redis/cluster
  3. # cp /usr/local/redis/redis.conf /usr/local/redis/cluster/redis_7001.conf
  5. # cp /usr/local/redis/redis.conf /usr/local/redis/cluster/redis_7002.conf
  7. # chown -R redis:redis /usr/local/redis
  9. # mkdir -p /data/redis/cluster/{redis_7001,redis_7002} && chown -R redis:redis /data/redis

192.168.30.128 7001 配置文件

  1. # vim /usr/local/redis/cluster/redis_7001.conf
  3. bind 192.168.30.128
  4. port 7001
  5. daemonize yes
  6. pidfile "/var/run/redis_7001.pid"
  7. logfile "/usr/local/redis/cluster/redis_7001.log"
  8. dir "/data/redis/cluster/redis_7001"
  9. #replicaof 192.168.30.129 6379
  10. masterauth 123456
  11. requirepass 123456
  12. appendonly yes
  13. cluster-enabled yes
  14. cluster-config-file nodes_7001.conf
  15. cluster-node-timeout 15000

192.168.30.128 7002 配置文件

  1. # vim /usr/local/redis/cluster/redis_7002.conf
  3. bind 192.168.30.128
  4. port 7002
  5. daemonize yes
  6. pidfile "/var/run/redis_7002.pid"
  7. logfile "/usr/local/redis/cluster/redis_7002.log"
  8. dir "/data/redis/cluster/redis_7002"
  9. #replicaof 192.168.30.129 6379
  10. masterauth "123456"
  11. requirepass "123456"
  12. appendonly yes
  13. cluster-enabled yes
  14. cluster-config-file nodes_7002.conf
  15. cluster-node-timeout 15000

启动redis服务：

  1. # redis-server /usr/local/redis/cluster/redis_7001.conf
  3. # tail -f /usr/local/redis/cluster/redis_7001.log
  5. # redis-server /usr/local/redis/cluster/redis_7002.conf
  7. # tail -f /usr/local/redis/cluster/redis_7002.log

redis5.0.4，所以不需要安装ruby，直接创建集群即可

  1. # redis-cli -a 123456 --cluster create 192.168.30.128:7001 192.168.30.128:7002 192.168.30.129:7003 192.168.30.129:7004 192.168.30.130:7005 192.168.30.130:7006 --cluster-replicas 1
  3. Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
  4. >>> Performing hash slots allocation on 6 nodes...
  5. Master[0] -> Slots 0 - 5460
  6. Master[1] -> Slots 5461 - 10922
  7. Master[2] -> Slots 10923 - 16383
  8. Adding replica 192.168.30.129:7004 【slave】 to 192.168.30.128:7001 【master】
  9. Adding replica 192.168.30.130:7006 【slave】 to 192.168.30.129:7003 【master】
  10. Adding replica 192.168.30.128:7002 【slave】 to 192.168.30.130:7005 【master】
  11. M: 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001
  12.    slots:[0-5460] (5461 slots) master
  13. S: b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002
  14.    replicates 6788453ee9a8d7f72b1d45a9093838efd0e501f1
  15. M: 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003
  16.    slots:[5461-10922] (5462 slots) master
  17. S: b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004
  18.    replicates 80c80a3f3e33872c047a8328ad579b9bea001ad8
  19. M: 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005
  20.    slots:[10923-16383] (5461 slots) master
  21. S: 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006
  22.    replicates 4d74ec66e898bf09006dac86d4928f9fad81f373
  23. Can I set the above configuration? (type 'yes' to accept): yes                  #输入yes，接受上面配置
  24. >>> Nodes configuration updated
  25. >>> Assign a different config epoch to each node
  26. >>> Sending CLUSTER MEET messages to join the cluster

自动生成的nodes.conf文件

  1. # ls /data/redis/cluster/redis_7001/
  2. appendonly.aof  dump.rdb  nodes-7001.conf
  4. # vim /data/redis/cluster/redis_7001/nodes-7001.conf 
  6. 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005@17005 master - 0 1557454406312 5 connected 10923-16383
  7. 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006@17006 slave 4d74ec66e898bf09006dac86d4928f9fad81f373 0 1557454407000 6 connected
  8. b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002@17002 slave 6788453ee9a8d7f72b1d45a9093838efd0e501f1 0 1557454408371 5 connected
  9. 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001@17001 myself,master - 0 1557454406000 1 connected 0-5460
  10. b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004@17004 slave 80c80a3f3e33872c047a8328ad579b9bea001ad8 0 1557454407366 4 connected
  11. 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003@17003 master - 0 1557454407000 3 connected 5461-10922
  12. vars currentEpoch 6 lastVoteEpoch 0

登录集群操作：

  1. # redis-cli -c -h 192.168.30.128 -p 7001 -a 123456                  # -c，使用集群方式登录

查看集群信息：

  1. 192.168.30.128:7001> CLUSTER INFO                   #集群状态
  3. cluster_state:ok
  4. cluster_slots_assigned:16384
  5. cluster_slots_ok:16384
  6. cluster_slots_pfail:0
  7. cluster_slots_fail:0
  8. cluster_known_nodes:6
  9. cluster_size:3
  10. cluster_current_epoch:6
  11. cluster_my_epoch:1
  12. cluster_stats_messages_ping_sent:580
  13. cluster_stats_messages_pong_sent:551
  14. cluster_stats_messages_sent:1131
  15. cluster_stats_messages_ping_received:546
  16. cluster_stats_messages_pong_received:580
  17. cluster_stats_messages_meet_received:5
  18. cluster_stats_messages_received:1131

列出节点信息： 这里与 nodes.conf 中的内容一致

  1. 192.168.30.128:7001> CLUSTER NODES                  #列出节点信息
  3. 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005@17005 master - 0 1557455176000 5 connected 10923-16383
  4. 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006@17006 slave 4d74ec66e898bf09006dac86d4928f9fad81f373 0 1557455174000 6 connected
  5. b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002@17002 slave 6788453ee9a8d7f72b1d45a9093838efd0e501f1 0 1557455175000 5 connected
  6. 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001@17001 myself,master - 0 1557455175000 1 connected 0-5460
  7. b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004@17004 slave 80c80a3f3e33872c047a8328ad579b9bea001ad8 0 1557455174989 4 connected
  8. 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003@17003 master - 0 1557455175995 3 connected 5461-10922

192.168.30.129上增加一节点：

  1. # cp /usr/local/redis/cluster/redis_7003.conf /usr/local/redis/cluster/redis_7007.conf
  3. # vim /usr/local/redis/cluster/redis_7007.conf
  5. bind 192.168.30.129
  6. port 7007
  7. daemonize yes
  8. pidfile "/var/run/redis_7007.pid"
  9. logfile "/usr/local/redis/cluster/redis_7007.log"
  10. dir "/data/redis/cluster/redis_7007"
  11. #replicaof 192.168.30.129 6379
  12. masterauth "123456"
  13. requirepass "123456"
  14. appendonly yes
  15. cluster-enabled yes
  16. cluster-config-file nodes_7007.conf
  17. cluster-node-timeout 15000
  19. # mkdir /data/redis/cluster/redis_7007
  21. # chown -R redis:redis /usr/local/redis && chown -R redis:redis /data/redis
  23. # redis-server /usr/local/redis/cluster/redis_7007.conf

192.168.30.130上增加一节点：

  1. # cp /usr/local/redis/cluster/redis_7005.conf /usr/local/redis/cluster/redis_7008.conf
  3. # vim /usr/local/redis/cluster/redis_7007.conf
  5. bind 192.168.30.130
  6. port 7008
  7. daemonize yes
  8. pidfile "/var/run/redis_7008.pid"
  9. logfile "/usr/local/redis/cluster/redis_7008.log"
  10. dir "/data/redis/cluster/redis_7008"
  11. #replicaof 192.168.30.130 6379
  12. masterauth "123456"
  13. requirepass "123456"
  14. appendonly yes
  15. cluster-enabled yes
  16. cluster-config-file nodes_7008.conf
  17. cluster-node-timeout 15000
  19. # mkdir /data/redis/cluster/redis_7008
  21. # chown -R redis:redis /usr/local/redis && chown -R redis:redis /data/redis
  23. # redis-server /usr/local/redis/cluster/redis_7008.conf

集群中增加节点：

  1. 192.168.30.129:7003> CLUSTER MEET 192.168.30.129 7007
  2. OK
  4. 192.168.30.129:7003> CLUSTER NODES
  6. 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003@17003 myself,master - 0 1557457361000 3 connected 5461-10922
  7. 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001@17001 master - 0 1557457364746 1 connected 0-5460
  8. 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006@17006 slave 4d74ec66e898bf09006dac86d4928f9fad81f373 0 1557457362000 6 connected
  9. b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004@17004 slave 80c80a3f3e33872c047a8328ad579b9bea001ad8 0 1557457363000 4 connected
  10. b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002@17002 slave 6788453ee9a8d7f72b1d45a9093838efd0e501f1 0 1557457362000 5 connected
  11. e51ab166bc0f33026887bcf8eba0dff3d5b0bf14 192.168.30.129:7007@17007 master - 0 1557457362729 0 connected
  12. 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005@17005 master - 0 1557457363739 5 connected 10923-16383
  14. 192.168.30.129:7003> CLUSTER MEET 192.168.30.130 7008
  15. OK
  17. 192.168.30.129:7003> CLUSTER NODES
  19. 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003@17003 myself,master - 0 1557457489000 3 connected 5461-10922
  20. 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001@17001 master - 0 1557457489000 1 connected 0-5460
  21. 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006@17006 slave 4d74ec66e898bf09006dac86d4928f9fad81f373 0 1557457489000 6 connected
  22. b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004@17004 slave 80c80a3f3e33872c047a8328ad579b9bea001ad8 0 1557457488000 4 connected
  23. b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002@17002 slave 6788453ee9a8d7f72b1d45a9093838efd0e501f1 0 1557457489472 5 connected
  24. 1a1c7f02fce87530bd5abdfc98df1cffce4f1767 192.168.30.130:7008@17008 master - 0 1557457489259 0 connected
  25. e51ab166bc0f33026887bcf8eba0dff3d5b0bf14 192.168.30.129:7007@17007 master - 0 1557457489000 0 connected
  26. 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005@17005 master - 0 1557457490475 5 connected 10923-16383

可以看到，新增的节点都是以master身份加入集群的

  • 更换节点身份：

将新增的192.168.30.130:7008节点身份改为192.168.30.129:7007的slave

  1. # redis-cli -c -h 192.168.30.130 -p 7008 -a 123456 cluster replicate e51ab166bc0f33026887bcf8eba0dff3d5b0bf14

cluster replicate后面跟node_id，更改对应节点身份。也可以登入集群更改

  1. # redis-cli -c -h 192.168.30.130 -p 7008 -a 123456
  3. 192.168.30.130:7008> CLUSTER REPLICATE e51ab166bc0f33026887bcf8eba0dff3d5b0bf14
  4. OK
  6. 192.168.30.130:7008> CLUSTER NODES
  8. 277daeb8660d5273b7c3e05c263f861ed5f17b92 192.168.30.130:7006@17006 slave 4d74ec66e898bf09006dac86d4928f9fad81f373 0 1557458316881 3 connected
  9. 80c80a3f3e33872c047a8328ad579b9bea001ad8 192.168.30.128:7001@17001 master - 0 1557458314864 1 connected 0-5460
  10. 4d74ec66e898bf09006dac86d4928f9fad81f373 192.168.30.129:7003@17003 master - 0 1557458316000 3 connected 5461-10922
  11. 6788453ee9a8d7f72b1d45a9093838efd0e501f1 192.168.30.130:7005@17005 master - 0 1557458315872 5 connected 10923-16383
  12. b4d3eb411a7355d4767c6c23b4df69fa183ef8bc 192.168.30.128:7002@17002 slave 6788453ee9a8d7f72b1d45a9093838efd0e501f1 0 1557458317890 5 connected
  13. 1a1c7f02fce87530bd5abdfc98df1cffce4f1767 192.168.30.130:7008@17008 myself,slave e51ab166bc0f33026887bcf8eba0dff3d5b0bf14 0 1557458315000 7 connected
  14. b6331cbc986794237c83ed2d5c30777c1551546e 192.168.30.129:7004@17004 slave 80c80a3f3e33872c047a8328ad579b9bea001ad8 0 1557458315000 1 connected
  15. e51ab166bc0f33026887bcf8eba0dff3d5b0bf14 192.168.30.129:7007@17007 master - 0 1557458314000 0 connected

发表评论

表情：
评论列表 （有 0 条评论，355人围观）

还没有评论，来说两句吧...

相关阅读