Kafka--安装与设置

Myth丶恋晨 2023-05-21 11:55 15阅读 0赞

原文网址：[Kafka--安装与设置\_IT利刃出鞘的博客-CSDN博客][Kafka--_IT_-CSDN]

# 其他网址 #

[Linux安装 springboot kafka的demo入门\_大数据\_阿拉斯加大闸蟹的博客-CSDN博客][Linux_ springboot kafka_demo_-CSDN]

# 安装单机Kafka #

## 步骤 ##

安装kafka需要安装：JDK+Zookeeper+Kafka。

**1.下载**

> 下载地址: [Apache Kafka][]

**2.解压**

**3.修改配置**

> 安装目录/config/server.properties
> 
>     log.dirs=D:\Kafka\kafka_2.12-0.11.0.0\kafka-logs    //日志路径
>     zookeeper.connect=localhost:2181                    //zookeeper地址
>     broker.id=0                                         //broker的唯一id

**4.启动**

> 1.启动zookeeper
> 
> 2.启动kafka
> 
>     .\bin\windows\kafka-server-start.bat ..\..\config\server.properties

**5.验证**

> 可以通过查看zookeeper中的节点来确认kafka是否启动。
> 
> 启动zookeeper的client（在命令行执行.\\zkCli.cmd -server 127.0.0.1:2181），然后输入ls /brokers/ids
> 
> ![20210214104417270.png][]
> 
> 这里的0就是broker.id，可见我们刚才配置的kafka启动成功了。

## 问题解决 ##

Kafka启动失败，查看kafka失败日志：Kafka安装目录/logs/server.log

**ID不匹配**

>     [2021-06-19 17:09:45,737] INFO Cluster ID = Gp_FULuuSTSKwBzkGtD1DQ (kafka.server.KafkaServer)
>     [2021-06-19 17:09:45,745] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
>     kafka.common.InconsistentClusterIdException: The Cluster ID Gp_FULuuSTSKwBzkGtD1DQ doesn't match stored clusterId Some(Ra3BVZxZSiqW7JomU_PWQA) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
>     	at kafka.server.KafkaServer.startup(KafkaServer.scala:252)
>     	at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
>     	at kafka.Kafka$.main(Kafka.scala:82)
>     	at kafka.Kafka.main(Kafka.scala)
>     [2021-06-19 17:09:45,747] INFO shutting down (kafka.server.KafkaServer)
>     [2021-06-19 17:09:45,749] INFO [feature-zk-node-event-process-thread]: Shutting down (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread)
>     [2021-06-19 17:09:45,750] INFO [feature-zk-node-event-process-thread]: Shutdown completed (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread)
>     [2021-06-19 17:09:45,750] INFO [feature-zk-node-event-process-thread]: Stopped (kafka.server.FinalizedFeatureChangeListener$ChangeNotificationProcessorThread)
>     [2021-06-19 17:09:45,751] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
>     [2021-06-19 17:09:45,865] INFO Session: 0x1002df2aca80000 closed (org.apache.zookeeper.ZooKeeper)
>     [2021-06-19 17:09:45,865] INFO EventThread shut down for session: 0x1002df2aca80000 (org.apache.zookeeper.ClientCnxn)
>     [2021-06-19 17:09:45,866] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
>     [2021-06-19 17:09:45,871] INFO App info kafka.server for 0 unregistered (org.apache.kafka.common.utils.AppInfoParser)
>     [2021-06-19 17:09:45,871] INFO shut down completed (kafka.server.KafkaServer)
>     [2021-06-19 17:09:45,872] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
>     [2021-06-19 17:09:45,873] INFO shutting down (kafka.server.KafkaServer)
> 
> 主要是这句：kafka.common.InconsistentClusterIdException: The Cluster ID Gp\_FULuuSTSKwBzkGtD1DQ doesn't match stored clusterId Some(Ra3BVZxZSiqW7JomU\_PWQA) in meta.properties. The broker is trying to join the wrong cluster. Configured zookeeper.connect may be wrong.
> 
> **解决方案** 
> 
> kafka配置日志路径，用来保存执行过程中的各种信息，当kafka异常关闭时，日志记录就会出现异常，会把当时的情况记录到meta.properties文件中，重新启动时此文件会对启动造成影响，kafka重启报错的原因就在这里。
> 
> a.直接删除日志：Kafka安装目录/logs。不要怕丢失,日志还会自动生成
> 
> b.删除meta-properties文件。对于windows：Kafka安装目录\\bin\\windows\\devkafka\_2.13-2.7.0kafka-logs

# 安装集群Kafka #

[Kafka--_IT_-CSDN]: https://knife.blog.csdn.net/article/details/105606117
[Linux_ springboot kafka_demo_-CSDN]: https://blog.csdn.net/singgel/article/details/83417907
[Apache Kafka]: http://kafka.apache.org/downloads.html
[20210214104417270.png]: /images/20230521/f7838eff19064c788d2bccc3ef2455d6.png