zookeeper集群部署(分布式)

一时失言乱红尘 2022-08-06 01:14 357阅读 0赞

描述

ZooKeeper可以用来保证数据在zookeeper集群之间的数据的事务一致性。

如何搭建ZooKeeper集群

  1. Zookeeper服务集群规模不小于三个节点,要求各服务之间系统时间要保持一致。

  2. 在hadoop0的usr/local目录下,解压缩zookeeper(执行命令tar –zvxf zookeeper.tar.gz)

  3. 设置环境变量

打开/etc/profile文件!内容如下:

  1. #set java & hadoop
  2. export JAVA_HOME=/usr/local/jdk
  3. export HADOOP_HOME=/usr/local/hadoop
  4. export ZOOKEEPER_HOME=/usr/local/zookeeper
  5. export PATH=.:$HADOOP_HOME/bin:$ZOOKEEPER_HOME/bin:$JAVA_HOME/bin:$PATH

注:修改完后profile记得执行source /etc/profile

  1. 在解压后的zookeeper的目录下进入conf目录修改配置文件

更名操作:mv zoo_sample.cfg zoo.cfg

  1. 编辑zoo.cfg (vi zoo.cfg)

修改dataDir=/usr/local/zookeeper/data/

新增server.0=hadoop0:2888:3888

  1. server.1=hadoop1:2888:3888
  2. server.2=hadoop2:2888:3888

文件如下:

  1. # The number of milliseconds of each tick
  2. tickTime=2000
  3. # The number of ticks that the initial
  4. # synchronization phase can take
  5. initLimit=10
  6. # The number of ticks that can pass between
  7. # sending a request and getting an acknowledgement
  8. syncLimit=5
  9. # the directory where the snapshot is stored.
  10. # do not use /tmp for storage, /tmp here is just
  11. # example sakes.
  12. dataDir=/usr/local/zookeeper/data
  13. # the port at which the clients will connect
  14. clientPort=2181
  15. #
  16. # Be sure to read the maintenance section of the
  17. # administrator guide before turning on autopurge.
  18. #
  19. # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
  20. #
  21. # The number of snapshots to retain in dataDir
  22. #autopurge.snapRetainCount=3
  23. # Purge task interval in hours
  24. # Set to "0" to disable auto purge feature
  25. #autopurge.purgeInterval=1
  26. server.0=hadoop0:2888:3888
  27. server.1=hadoop1:2888:3888
  28. server.2=hadoop2:2888:3888

注:

server.0=hadoop0:2888:3888

server.1=hadoop1:2888:3888

server.2=hadoop2:2888:3888

这三行为配置zookeeper集群的机器(hadoop0、hadoop1、hadoop2)分别用server.0和server.1、server.2标识,2888和3888为端口号(zookeeper集群包含一个leader(领导)和多个fllower(随从),启动zookeeper集群时会随机分配端口号,分配的端口号为2888的为leader,端口号为3888的是fllower)


  1. 创建文件夹mkdir /usr/local/zookeeper/data

  2. 在data目录下,创建文件myid,值为0 (0用来标识hadoop0这台机器的zookeeper )

到此为止 hadoop0上的配置就已经完成;接下来配置hadoop1和hadoop2.


  1. 把zookeeper目录复制到hadoop1和hadoop2中(scp –r /usr/local/zookeeper hadoop1:/usr/local)

  2. 把修改后的etc/profile文件复制到hadoop1和hadoop2中

(复制完后记得在hadoop1和hadoop2中执行命令source /etc/profile)

  1. 把hadoop1中相应的myid中的值改为1,hadoop2中相应的myid中的值改为2

  2. 启动,在三个节点上分别执行命令zkServer.sh start

  3. 检验,在三个节点上分别执行命令zkServer.sh status

zookeeper的shell操作

启动zookeeper:zkServer.sh start

进入zookeeper:zkCli.sh

发表评论

表情:
评论列表 (有 0 条评论,357人围观)

还没有评论,来说两句吧...

相关阅读