【kafka】使用jmeter压测kafka并发性能

我不是女神ヾ 2022-10-29 07:31 294阅读 0赞

## 1、idea中开发kafka并发测试需要的扩展包 ##

由于jmeter的jms模块并不支持kafka，因此需要扩展开发  
引入jmeter

<dependency>
                <groupId>org.apache.jmeter</groupId>
                <artifactId>ApacheJMeter_core</artifactId>
                <version>5.4.1</version>
                <scope>provided</scope>
            </dependency>
            <dependency>
                <groupId>org.apache.jmeter</groupId>
                <artifactId>ApacheJMeter_java</artifactId>
                <version>5.4.1</version>
                <scope>provided</scope>
            </dependency>

编写向kafka发送消息的核心逻辑，继承AbstractJavaSamplerClient

public class JmeterTest extends AbstractJavaSamplerClient {
    
        private static final Logger log = LoggerFactory.getLogger(JmeterTest.class);
    
        private KafkaProducer producer;
    
        private Integer dataSize;
    
        private Integer dataNum;
    
        private String topic;
    
        // SampleResult类封装了从入口样本返回的各种信息
        private SampleResult results;
    
        /**
         * 创建生产者实例
        */
        private void init() {
            if (producer == null) {
                // ...
                Map<String, Object> kafkaProperites = ConfigUtil.getProducerParams(openSsl, "jmeter-test");
                producer = new KafkaProducer(kafkaProperites);
            }
        }
    
        @Override
        public Arguments getDefaultParameters() {
            // 声明定义Arguments类
            Arguments params = new Arguments();
            // 添加一个新参数
            params.addArgument("dataSize", "4608");
            params.addArgument("dataNum", "1");
            params.addArgument("topic", "test_topic_1");
            return params;
        }
    
        @Override
        public void setupTest(JavaSamplerContext jsc) {
            // 定义SampleResult类
            results = new SampleResult();
            // 以String形式获取指定参数的值，或者如果未指定该值，则返回指定的默认值
            dataSize = jsc.getIntParameter("dataSize", 4608);
            dataNum = jsc.getIntParameter("dataNum", 1);
            topic = jsc.getParameter("topic", "test_topic_1");
        }
    
    
        @Override
        public SampleResult runTest(JavaSamplerContext javaSamplerContext) {
            init();
            ProducerRecord<String, byte[]> record = getRecord();
            results.sampleStart();
            for (int i = 0; i < dataNum; i++) {
                producer.send(record);
            }
    
            results.sampleEnd();
            //由于kafka的错误基本上都是警告，没法通过异常捕获知道，这里直接返回成功了，真正是否成功还得通过日志定位， 待优化
            results.setSuccessful(true);
            results.setResponseData("send " + dataNum + " records to " + topic, StandardCharsets.UTF_8.name());
            producer.close();
            return results;
        }
    	// 构造dataSize大小的随机数据
        private ProducerRecord<String, byte[]> getRecord() {
            byte[] payload = null;
            Random random = new Random(0);
            if (dataSize != null) {
                payload = new byte[dataSize];
                for (int i = 0; i < payload.length; ++i)
                    payload[i] = (byte) (random.nextInt(26) + 65);
            }
    
            ProducerRecord<String, byte[]> record = new ProducerRecord<>(topic, payload);
            return record;
        }
    }

## 2、在windows环境中用可视化页面配置 ##

添加线程组，组下面添加取样器-》Java请求  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70]  
配置java请求的自定义类路径  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 1]  
将配置好的线程组保存成jmx文件

## 3、上传至linux环境中执行 ##

问题：执行jmeter报没有权限  
![在这里插入图片描述][20210209121036604.png]  
给整个bin目录赋执行权限即可  
![在这里插入图片描述][20210209121101727.png]  
然后执行sh ./jmeter.sh -v，显示jmeter的banner就ok啦  
![在这里插入图片描述][20210209145259692.png]

执行我们配好的jmx文件  
sh jmeter.sh -n -t kafka-producer.jmx -l result.jtl  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 2]

## 4、收集结果 ##

回到windows系统，在jmeter中添加一个“聚合报告”，打开result.jtl  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 3]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70]: /images/20221024/20251f28ab8a49908baa297fa89c2c23.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 1]: /images/20221024/94d35a6f876c4f738686277a5c7984f0.png
[20210209121036604.png]: /images/20221024/ed0191e4b6d34104b68c96460f7eb317.png
[20210209121101727.png]: /images/20221024/2ea113e605cb4e668bcfda5cbf8fe8cd.png
[20210209145259692.png]: /images/20221024/eaf7b6a2350d43feb451b43e818c3cc8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 2]: /images/20221024/bfeb096a6fb94a67bc7d92b4b2410e47.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjE0MjA0Mg_size_16_color_FFFFFF_t_70 3]: /images/20221024/2f049d662d0a4c8bbee3f23d5422269a.png