8.【kafka运维】kafka-dump-log.sh数据查看 「爱情、让人受尽委屈。」 2022-09-05 12:53 132阅读 0赞 > **日常运维** > **问题排查** > 怎么能够少了滴滴开源的 > [滴滴开源LogiKM一站式Kafka监控与管控平台][LogiKM_Kafka] ## 1.查看日志文件 kafka-dump-log.sh ## <table> <thead> <tr> <th>参数</th> <th>描述</th> <th>例子</th> </tr> </thead> <tbody> <tr> <td><code>--deep-iteration</code></td> <td></td> <td></td> </tr> <tr> <td><code>--files <String: file1, file2, ...></code></td> <td>必需; 读取的日志文件</td> <td>–files 0000009000.log</td> </tr> <tr> <td><code>--key-decoder-class</code></td> <td>如果设置,则用于反序列化键。这类应实现kafka.serializer。解码器特性。自定义jar应该是在kafka/libs目录中提供</td> <td></td> </tr> <tr> <td><code>--max-message-size</code></td> <td>最大的数据量,默认:5242880</td> <td></td> </tr> <tr> <td><code>--offsets-decoder</code></td> <td>if set, log data will be parsed as offset data from the __consumer_offsets topic.</td> <td></td> </tr> <tr> <td><code>--print-data-log</code></td> <td>打印内容</td> <td></td> </tr> <tr> <td><code>--transaction-log-decoder</code></td> <td>if set, log data will be parsed as transaction metadata from the __transaction_state topic</td> <td></td> </tr> <tr> <td><code>--value-decoder-class [String]</code></td> <td>if set, used to deserialize the messages. This class should implement kafka. serializer.Decoder trait. Custom jar should be available in kafka/libs directory. (default: kafka.serializer. StringDecoder)</td> <td></td> </tr> <tr> <td><code>--verify-index-only</code></td> <td>if set, just verify the index log without printing its content.</td> <td></td> </tr> </tbody> </table> **查询Log文件** > `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.log` > ![在这里插入图片描述][e90ad7f1c39e5208120080475845dbb3.png] **查询Log文件具体信息 `--print-data-log`** > `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.log --print-data-log` > ![在这里插入图片描述][3306f80db58a943e6a59c39e66b4c4fe.png] **查询index文件具体信息** > `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.index` > ![在这里插入图片描述][bd918af516229bbb80640483831d6595.png] > 配置项为`log.index.size.max.bytes`; 来控制创建索引的大小; **查询timeindex文件** > `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.timeindex` > ![在这里插入图片描述][2254d080ca4e63d13714b40b6c0c3b63.png] -------------------- 欢迎 Star和 共建由 滴滴开源的kafka的管理平台,非常优秀非常好用的一款kafka管理平台 满足所有开发运维日常需求 [滴滴开源Logi-KafkaManager 一站式Kafka监控与管控平台][LogiKM_Kafka] ## More ## Kafka专栏持续更新中…(源码、原理、实战、运维、视频、面试视频) -------------------- [【kafka运维】Kafka全网最全最详细运维命令合集(精品强烈建议收藏!!!)\_石臻臻的杂货铺-CSDN博客][kafka_Kafka_-CSDN] [【kafka实战】分区重分配可能出现的问题和排查问题思路(生产环境实战,干货!!!非常干!!!建议收藏)][kafka] [【kafka异常】kafka 常见异常处理方案(持续更新! 建议收藏)][kafka_kafka _] [【kafka运维】分区从分配、数据迁移、副本扩缩容 (附教学视频)][kafka_] [【kafka源码】ReassignPartitionsCommand源码分析(副本扩缩、数据迁移、副本重分配、副本跨路径迁移][kafka_ReassignPartitionsCommand] [【kafka】点击更多…][kafka 1] [LogiKM_Kafka]: https://github.com/didi/LogiKM [e90ad7f1c39e5208120080475845dbb3.png]: /images/20220829/49f92cf0018247aaabaad2bded8ed2cf.png [3306f80db58a943e6a59c39e66b4c4fe.png]: /images/20220829/bedf64872c074fb1b87b333b6367d068.png [bd918af516229bbb80640483831d6595.png]: /images/20220829/b5928215c4e54a45bc6d7c92cef0ccdb.png [2254d080ca4e63d13714b40b6c0c3b63.png]: /images/20220829/7c65a5cca19748e9bb7a9b345e2d64b1.png [kafka_Kafka_-CSDN]: https://blog.csdn.net/u010634066/article/details/118215928?spm=1001.2014.3001.5501 [kafka]: https://blog.csdn.net/u010634066/article/details/118631272?spm=1001.2014.3001.5501 [kafka_kafka _]: https://blog.csdn.net/u010634066/article/details/118105676?spm=1001.2014.3001.5501 [kafka_]: https://blog.csdn.net/u010634066/article/details/118028403?spm=1001.2014.3001.5501 [kafka_ReassignPartitionsCommand]: https://blog.csdn.net/u010634066/article/details/118051963 [kafka 1]: https://mp.weixin.qq.com/mp/appmsgalbum?__biz=Mzg4ODY1NTcxNg==&action=getalbum&album_id=1966026980307304450#wechat_redirect
还没有评论,来说两句吧...