Kafka集群部署与测试

迈不过友情╰ 2024-04-05 07:11 73阅读 0赞

**目录**

Kafka集群部署与测试

一、安装Kafka

二、启动kafka服务

--------------------

### **Kafka集群部署与测试** ###

#### **一、安装Kafka** ####

**①、Alt+P 拷贝安装包**

![9bc258764e65489da02e91dc593ce249.png][]

**cd /opt/module**

**tar -zxvf /opt/software/kafka\_2.11-2.0.0.tgz -C /opt/module/**

![68cd1a6a692e439b9be3f9bbf8908123.png][]

**②、修改配置文件**

**vi /opt/module/kafka\_2.11-2.0.0/config/server.properties**

![282f9947af6b4f21af495a4b8114879b.png][]

![cbe6eb3a6ac74f8c8f7f2bab28c39e8b.png][]

![e26ea79728e549ccadce4bc50c701985.png][]

![f3bab59b528a40078a40dc351868ab33.png][]

![18f8faeb25554c5d9d99d2493b84a17c.png][]

**增加环境变量**

**vi /etc/profile**

**export KAFKA\_HOME=/opt/module/kafka\_2.11-2.0.0**

**export PATH=$PATH:$KAFKA\_HOME/bin**

![7dcb0857adb04ffda4bcf25cf758be69.png][]

**Step1、分发文件**

**chown -R hadoop:hadoop /opt/**

**su hadoop**

**scp -r kafka\_2.11-2.0.0/ slave1:/opt/module/**

**scp -r kafka\_2.11-2.0.0/ slave****2****:/opt/module/**

![52fda7792ad94dae9e8a7b5f27c5576c.png][]

![66ce8af48fe84c2daec6d93d01ac6c8f.png][]

**Step2、再slave1和slave2节点上修改：**

**1．环境变量**

**Slave1****里更改**

**vi /etc/prof**

export KAFKA_HOME=/opt/module/kafka_2.11-2.0.0
    
    export PATH=$PATH:$KAFKA_HOME/bin

![80d029e4f175438dbf532cffa64d2b69.png][]

**S****lave****2****里修改**

**vi /etc/prof**

export KAFKA_HOME=/opt/module/kafka_2.11-2.0.0
    
    export PATH=$PATH:$KAFKA_HOME/bin

![d6791ff1a3d34e12975c85509d956637.png][]

**2． 修改 broker.id 和host.name**

**Slave1****里更改**

**vi /opt/module/kafka\_2.11-2.0.0/config/server.properties**

![6dbc95c4039c4becb8212b2069788e18.png][]

![50d597c563614b3495ae885a7fa0fe9f.png][]

**Slave2****里更改**

**vi /opt/module/kafka\_2.11-2.0.0/config/server.properties**

![8d5bcf5f36f8414f86136bb5621a9697.png][]

![13e2c06eddf74a06972f73b8890789a0.png][]

#### **二、启动kafka服务** ####

*  **、在三个节点上依次启动Zookeeper**

**ZkServer.sh start**

![cdbbbdd846a442d7a5fee125d41c33e4.png][]

**Step 2 启动kafka（****三个节点都要启动****）**

**/opt/module/kafka\_2.11-2.0.0/bin/kafka-server-start.sh /opt/module/kafka\_2.11-2.0.0/config/server.properties**

![7620039bdb6c4f3a91da4ffe1e6de648.png][]

**注意：kafka启动后本终端不能管理，关闭会导致Kafka停止**

**Step 3 再开一个命令终端，查看kafka进程**

![814c44cf48e74d2a9f98a0319f34170a.png][]

**su Hadoop**

**jps**

![c73e083cb5ef4310b99c45e7e31abce0.png][]

[9bc258764e65489da02e91dc593ce249.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/64ccc1db07ef432b882a7f3da965441d.png
[68cd1a6a692e439b9be3f9bbf8908123.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/46c157d3732848a3b4c6b0ad418bf7c5.png
[282f9947af6b4f21af495a4b8114879b.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/02e13fecde0046afafc2837ce60fb264.png
[cbe6eb3a6ac74f8c8f7f2bab28c39e8b.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/c86184b08a5146ee8652e797561a746e.png
[e26ea79728e549ccadce4bc50c701985.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/bfe62138af504791a2a67a1920cc5804.png
[f3bab59b528a40078a40dc351868ab33.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/84ab41611cb54f628126e51c69c7b135.png
[18f8faeb25554c5d9d99d2493b84a17c.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/992205ab2c1a44fb911f1fa9bd94587f.png
[7dcb0857adb04ffda4bcf25cf758be69.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/942c2b2b367d4882a142e807046a23e1.png
[52fda7792ad94dae9e8a7b5f27c5576c.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/f973c824d6e144a49c2f917b8fc7fa1f.png
[66ce8af48fe84c2daec6d93d01ac6c8f.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/3c4eead8a8de42099c45e2ee076c9f5b.png
[80d029e4f175438dbf532cffa64d2b69.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/9b35ba6a468c45d79bf2b5dd7e95fea7.png
[d6791ff1a3d34e12975c85509d956637.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/6ebce553217b4f05b6e037c5acfb429e.png
[6dbc95c4039c4becb8212b2069788e18.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/240270a4b8104f8e83709ad34df026c1.png
[50d597c563614b3495ae885a7fa0fe9f.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/8fbdb39500ef438297fba08f75c0103f.png
[8d5bcf5f36f8414f86136bb5621a9697.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/d466998dbbb14d27a8902b4802813d71.png
[13e2c06eddf74a06972f73b8890789a0.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/b930c3fe00094afca8c39442832ecded.png
[cdbbbdd846a442d7a5fee125d41c33e4.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/c39b755ef7964c41ab8575cdf4074a74.png
[7620039bdb6c4f3a91da4ffe1e6de648.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/e97e82c26ee247539b8fb4cc77600514.png
[814c44cf48e74d2a9f98a0319f34170a.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/1cc29bc5a1fc43848f920c596cc1744e.png
[c73e083cb5ef4310b99c45e7e31abce0.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/04/04/027ca0fa98ec46119401269a7ba0982a.png