8.【kafka运维】kafka-dump-log.sh数据查看

「爱情、让人受尽委屈。」 2022-09-05 12:53 129阅读 0赞

> **日常运维**  
> **问题排查**  
> 怎么能够少了滴滴开源的  
> [滴滴开源LogiKM一站式Kafka监控与管控平台][LogiKM_Kafka]

## 1.查看日志文件 kafka-dump-log.sh ##

<table> 
 <thead> 
  <tr> 
   <th>参数</th> 
   <th>描述</th> 
   <th>例子</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td><code>--deep-iteration</code></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--files &lt;String: file1, file2, ...&gt;</code></td> 
   <td>必需; 读取的日志文件</td> 
   <td>–files 0000009000.log</td> 
  </tr> 
  <tr> 
   <td><code>--key-decoder-class</code></td> 
   <td>如果设置，则用于反序列化键。这类应实现kafka.serializer。解码器特性。自定义jar应该是在kafka/libs目录中提供</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--max-message-size</code></td> 
   <td>最大的数据量,默认：5242880</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--offsets-decoder</code></td> 
   <td>if set, log data will be parsed as offset data from the __consumer_offsets topic.</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--print-data-log</code></td> 
   <td>打印内容</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--transaction-log-decoder</code></td> 
   <td>if set, log data will be parsed as transaction metadata from the __transaction_state topic</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--value-decoder-class [String]</code></td> 
   <td>if set, used to deserialize the messages. This class should implement kafka. serializer.Decoder trait. Custom jar should be available in kafka/libs directory. (default: kafka.serializer. StringDecoder)</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><code>--verify-index-only</code></td> 
   <td>if set, just verify the index log without printing its content.</td> 
   <td></td> 
  </tr> 
 </tbody> 
</table>

**查询Log文件**

> `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.log`  
> ![在这里插入图片描述][e90ad7f1c39e5208120080475845dbb3.png]

**查询Log文件具体信息 `--print-data-log`**

> `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.log --print-data-log`  
> ![在这里插入图片描述][3306f80db58a943e6a59c39e66b4c4fe.png]

**查询index文件具体信息**

> `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.index`  
> ![在这里插入图片描述][bd918af516229bbb80640483831d6595.png]  
> 配置项为`log.index.size.max.bytes`； 来控制创建索引的大小;

**查询timeindex文件**

> `sh bin/kafka-dump-log.sh --files kafka-logs-0/test2-0/00000000000000000300.timeindex`  
> ![在这里插入图片描述][2254d080ca4e63d13714b40b6c0c3b63.png]

--------------------

欢迎 Star和 共建由 滴滴开源的kafka的管理平台,非常优秀非常好用的一款kafka管理平台  
满足所有开发运维日常需求

[滴滴开源Logi-KafkaManager 一站式Kafka监控与管控平台][LogiKM_Kafka]

## More ##

Kafka专栏持续更新中…(源码、原理、实战、运维、视频、面试视频)

--------------------

[【kafka运维】Kafka全网最全最详细运维命令合集(精品强烈建议收藏!!!)\_石臻臻的杂货铺-CSDN博客][kafka_Kafka_-CSDN]

[【kafka实战】分区重分配可能出现的问题和排查问题思路(生产环境实战,干货!!!非常干!!!建议收藏)][kafka]

[【kafka异常】kafka 常见异常处理方案(持续更新! 建议收藏)][kafka_kafka _]

[【kafka运维】分区从分配、数据迁移、副本扩缩容 (附教学视频)][kafka_]

[【kafka源码】ReassignPartitionsCommand源码分析(副本扩缩、数据迁移、副本重分配、副本跨路径迁移][kafka_ReassignPartitionsCommand]

[【kafka】点击更多…][kafka 1]

[LogiKM_Kafka]: https://github.com/didi/LogiKM
[e90ad7f1c39e5208120080475845dbb3.png]: /images/20220829/49f92cf0018247aaabaad2bded8ed2cf.png
[3306f80db58a943e6a59c39e66b4c4fe.png]: /images/20220829/bedf64872c074fb1b87b333b6367d068.png
[bd918af516229bbb80640483831d6595.png]: /images/20220829/b5928215c4e54a45bc6d7c92cef0ccdb.png
[2254d080ca4e63d13714b40b6c0c3b63.png]: /images/20220829/7c65a5cca19748e9bb7a9b345e2d64b1.png
[kafka_Kafka_-CSDN]: https://blog.csdn.net/u010634066/article/details/118215928?spm=1001.2014.3001.5501
[kafka]: https://blog.csdn.net/u010634066/article/details/118631272?spm=1001.2014.3001.5501
[kafka_kafka _]: https://blog.csdn.net/u010634066/article/details/118105676?spm=1001.2014.3001.5501
[kafka_]: https://blog.csdn.net/u010634066/article/details/118028403?spm=1001.2014.3001.5501
[kafka_ReassignPartitionsCommand]: https://blog.csdn.net/u010634066/article/details/118051963
[kafka 1]: https://mp.weixin.qq.com/mp/appmsgalbum?__biz=Mzg4ODY1NTcxNg==&action=getalbum&album_id=1966026980307304450#wechat_redirect