MySQL性能半同步复制VS异步复制

冷不防 2022-12-22 13:29 133阅读 0赞

# 性能测试报告 #

![在这里插入图片描述][20201120160301626.png_pic_center]  
•从当前性能测试来看其实半同步复制与异步复制差距并不大，只是略微有点差距  
•都说半同步复制比异步复制性能慢了好多，为什么当前测试却差距这么小呢？  
原因一：半同步复制时只有一个slave库，同时 rpl\_semi\_sync\_master\_wait\_for\_slave\_count 参数也是 1 （ 表示master接收到几个slave应答后才commit ），如果是一主二从，需要两个slave应答时性能自然会降低一些。

原因二：压测时一直是对master主库进行的，此时slave是没有大量查询的压力，响应接收binlog的ack自然会回复的比较快，如果在slave有较大的压力时，性能也会再次降低。

说一千道一万，那到底使用半同步复制好还是使用异步复制好呢？  
•举个栗子：如果你是一主三从架构，你可以一个从库使用半同步复制，其余两个从库使用异步复制。当前最大限制保证了数据安全和数据的一致性。

# 半同步复制压力测试 #

![在这里插入图片描述][20201120160315794.png_pic_center]  
**1. 建立GTID半同步复制**

# 主库查看GTID开启状态
    3306 > show variables like '%gtid%';
    +----------------------------------+-----------+
    | Variable_name                    | Value     |
    +----------------------------------+-----------+
    | binlog_gtid_simple_recovery      | ON        |
    | enforce_gtid_consistency         | ON        |
    | gtid_executed_compression_period | 1000      |
    | gtid_mode                        | ON        |
    | gtid_next                        | AUTOMATIC |
    | gtid_owned                       |           |
    | gtid_purged                      |           |
    | session_track_gtids              | OFF       |
    +----------------------------------+-----------+
    8 rows in set (0.00 sec)
    
    # 从库查看GTID开启状态
    3307 > show variables like '%gtid%';
    +----------------------------------+-----------+
    | Variable_name                    | Value     |
    +----------------------------------+-----------+
    | binlog_gtid_simple_recovery      | ON        |
    | enforce_gtid_consistency         | ON        |
    | gtid_executed_compression_period | 1000      |
    | gtid_mode                        | ON        |
    | gtid_next                        | AUTOMATIC |
    | gtid_owned                       |           |
    | gtid_purged                      |           |
    | session_track_gtids              | OFF       |
    +----------------------------------+-----------+
    8 rows in set (0.00 sec)
    
    # 主库安装半同步插件 -------------------------------
    3306 > install plugin rpl_semi_sync_master soname 'semisync_master.so';
    Query OK, 0 rows affected (0.00 sec)
    
    3306 > select plugin_name,plugin_status from information_schema.plugins where plugin_name like '%semi_sync%';
    +----------------------+---------------+
    | plugin_name          | plugin_status |
    +----------------------+---------------+
    | rpl_semi_sync_master | ACTIVE        |
    +----------------------+---------------+
    1 row in set (0.00 sec)
    
    3306 > set global rpl_semi_sync_master_enabled = 1;
    Query OK, 0 rows affected (0.00 sec)
    
    # 从库安装半同步插件 -------------------------------
    3307 > install plugin rpl_semi_sync_slave soname 'semisync_slave.so';
    Query OK, 0 rows affected (0.06 sec)
    
    3307 > select plugin_name,plugin_status from information_schema.plugins where plugin_name like '%semi_sync%';
    +---------------------+---------------+
    | plugin_name         | plugin_status |
    +---------------------+---------------+
    | rpl_semi_sync_slave | ACTIVE        |
    +---------------------+---------------+
    1 row in set (0.00 sec)
    
    3307 > set global rpl_semi_sync_slave_enabled= 1;
    Query OK, 0 rows affected (0.00 sec)
    
    # 主库创建复制用户 --------------------------------------------------------------
    3306 > grant replication slave on *.* to repl@'%' identified by '123456';
    Query OK, 0 rows affected, 1 warning (0.00 sec)
    
    # 从库建立复制通道
    3307 > CHANGE MASTER TO
              MASTER_HOST='10.186.61.30',
              MASTER_USER='repl',
              MASTER_PASSWORD='123456',
              MASTER_PORT=3306,
              MASTER_CONNECT_RETRY=10,
              MASTER_AUTO_POSITION=1;
    Query OK, 0 rows affected, 2 warnings (0.03 sec)
    
    3307 > start slave;
    Query OK, 0 rows affected (0.00 sec)

1.  压力测试半同步模式数据库

# 主库创建压力测试的数据库
    3306 > create database testdb;
    Query OK, 1 row affected (0.00 sec)
    
    # 主库创建压力测试用户
    3306 > grant all on *.* to root@'%' identified by '123456';
    Query OK, 0 rows affected, 1 warning (0.01 sec)

# 模拟测试数据
    [root@db ~]# sysbench /usr/share/sysbench/tests/include/oltp_legacy/oltp.lua --mysql-host=10.186.61.30 --mysql-port=3306 --mysql-user=root --mysql-password=123456 --mysql-db=testdb --oltp-table-size=200000 --oltp-tables-count=8 --threads=4 --events=0 --time=3600 --report-interval=3 prepare
    sysbench 1.0.17 (using system LuaJIT 2.0.4)
    
    Creating table 'sbtest1'...
    Inserting 200000 records into 'sbtest1'
    Creating secondary indexes on 'sbtest1'...
    Creating table 'sbtest2'...
    Inserting 200000 records into 'sbtest2'
    Creating secondary indexes on 'sbtest2'...
    Creating table 'sbtest3'...
    Inserting 200000 records into 'sbtest3'
    Creating secondary indexes on 'sbtest3'...
    Creating table 'sbtest4'...
    Inserting 200000 records into 'sbtest4'
    Creating secondary indexes on 'sbtest4'...
    Creating table 'sbtest5'...
    Inserting 200000 records into 'sbtest5'
    Creating secondary indexes on 'sbtest5'...
    Creating table 'sbtest6'...
    Inserting 200000 records into 'sbtest6'
    Creating secondary indexes on 'sbtest6'...
    Creating table 'sbtest7'...
    Inserting 200000 records into 'sbtest7'
    Creating secondary indexes on 'sbtest7'...
    Creating table 'sbtest8'...
    Inserting 200000 records into 'sbtest8'
    Creating secondary indexes on 'sbtest8'...

# 压力测试 60 秒
    [root@db ~]# sysbench /usr/share/sysbench/tests/include/oltp_legacy/oltp.lua --mysql-host=10.186.61.30 --mysql-port=3306 --mysql-user=root --mysql-password=123456 --mysql-db=testdb --oltp-table-size=200000 --oltp-tables-count=8 --threads=4 --events=0 --time=60 --report-interval=3 run
    sysbench 1.0.17 (using system LuaJIT 2.0.4)
    
    Running the test with following options:
    Number of threads: 4
    Report intermediate results every 3 second(s)
    Initializing random number generator from current time
    
    Initializing worker threads...
    
    Threads started!
    
    [ 3s ] thds: 4 tps: 599.32 qps: 11998.32 (r/w/o: 8401.09/2397.26/1199.96) lat (ms,95%): 11.04 err/s: 0.00 reconn/s: 0.00
    [ 6s ] thds: 4 tps: 740.06 qps: 14808.55 (r/w/o: 10364.19/2964.24/1480.12) lat (ms,95%): 8.58 err/s: 0.00 reconn/s: 0.00
    [ 9s ] thds: 4 tps: 761.70 qps: 15239.62 (r/w/o: 10668.43/3047.79/1523.39) lat (ms,95%): 8.74 err/s: 0.00 reconn/s: 0.00
    [ 12s ] thds: 4 tps: 766.66 qps: 15327.62 (r/w/o: 10730.97/3063.32/1533.33) lat (ms,95%): 8.43 err/s: 0.00 reconn/s: 0.00
    [ 15s ] thds: 4 tps: 770.31 qps: 15407.89 (r/w/o: 10784.03/3083.25/1540.62) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 18s ] thds: 4 tps: 775.37 qps: 15504.64 (r/w/o: 10854.78/3099.13/1550.73) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 21s ] thds: 4 tps: 796.65 qps: 15931.60 (r/w/o: 11151.39/3187.25/1592.96) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 24s ] thds: 4 tps: 766.31 qps: 15325.15 (r/w/o: 10726.31/3065.90/1532.95) lat (ms,95%): 8.43 err/s: 0.00 reconn/s: 0.00
    [ 27s ] thds: 4 tps: 750.69 qps: 15016.21 (r/w/o: 10512.05/3002.78/1501.39) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 30s ] thds: 4 tps: 767.35 qps: 15349.98 (r/w/o: 10745.89/3069.40/1534.70) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 33s ] thds: 4 tps: 744.96 qps: 14894.10 (r/w/o: 10425.70/2978.49/1489.91) lat (ms,95%): 9.39 err/s: 0.00 reconn/s: 0.00
    [ 36s ] thds: 4 tps: 752.64 qps: 15050.90 (r/w/o: 10535.03/3010.58/1505.29) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 39s ] thds: 4 tps: 786.04 qps: 15721.48 (r/w/o: 11006.57/3142.83/1572.08) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 42s ] thds: 4 tps: 782.34 qps: 15649.87 (r/w/o: 10955.81/3129.37/1564.69) lat (ms,95%): 8.43 err/s: 0.00 reconn/s: 0.00
    [ 45s ] thds: 4 tps: 790.66 qps: 15810.29 (r/w/o: 11063.97/3164.99/1581.33) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 48s ] thds: 4 tps: 741.67 qps: 14829.09 (r/w/o: 10381.40/2964.35/1483.34) lat (ms,95%): 9.06 err/s: 0.00 reconn/s: 0.00
    [ 51s ] thds: 4 tps: 773.67 qps: 15474.64 (r/w/o: 10831.31/3095.99/1547.33) lat (ms,95%): 8.74 err/s: 0.00 reconn/s: 0.00
    [ 54s ] thds: 4 tps: 778.59 qps: 15580.14 (r/w/o: 10908.26/3114.69/1557.18) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 57s ] thds: 4 tps: 801.73 qps: 16031.28 (r/w/o: 11219.90/3207.92/1603.46) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 60s ] thds: 4 tps: 761.29 qps: 15228.56 (r/w/o: 10660.79/3045.18/1522.59) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    SQL statistics:
        queries performed:
            read:                            638806
            write:                           182516
            other:                           91258
            total:                           912580
        transactions:                        45629  (760.35 per sec.)
        queries:                             912580 (15207.04 per sec.)
        ignored errors:                      0      (0.00 per sec.)
        reconnects:                          0      (0.00 per sec.)
    
    General statistics:
        total time:                          60.0090s
        total number of events:              45629
    
    Latency (ms):
             min:                                    2.87
             avg:                                    5.26
             max:                                  139.25
             95th percentile:                        8.58
             sum:                               239890.13
    
    Threads fairness:
        events (avg/stddev):           11407.2500/82.92
        execution time (avg/stddev):   59.9725/0.00

# 异步复制压力测试 #

![在这里插入图片描述][20201120160442429.png_pic_center]

# 1. 切换GTID异步复制 #

# 关闭 主库 半同步插件
    3306 > set global rpl_semi_sync_master_enabled = 0;
    Query OK, 0 rows affected (0.31 sec)
    
    3306 > show status like 'Rpl_semi_sync_master_status';
    +-----------------------------+-------+
    | Variable_name               | Value |
    +-----------------------------+-------+
    | Rpl_semi_sync_master_status | OFF   |
    +-----------------------------+-------+
    1 row in set (0.00 sec)
    
    # 关闭 从库 半同步插件 -------------------------------
    3307 > set global rpl_semi_sync_slave_enabled= 0;
    Query OK, 0 rows affected (0.00 sec)
    
    3307 > stop slave io_thread;
    Query OK, 0 rows affected (0.00 sec)
    
    3307 > start slave io_thread;
    Query OK, 0 rows affected (0.00 sec)
    
    3307 > show status like 'Rpl_semi_sync_slave_status';
    +----------------------------+-------+
    | Variable_name              | Value |
    +----------------------------+-------+
    | Rpl_semi_sync_slave_status | OFF   |
    +----------------------------+-------+
    1 row in set (0.01 sec)

# 2.压力测试异步模式数据库 #

[root@db ~]# sysbench /usr/share/sysbench/tests/include/oltp_legacy/oltp.lua --mysql-host=10.186.61.30 --mysql-port=3306 --mysql-user=root --mysql-password=123456 --mysql-db=testdb --oltp-table-size=200000 --oltp-tables-count=8 --threads=4 --events=0 --time=60 --report-interval=3 run
    sysbench 1.0.17 (using system LuaJIT 2.0.4)
    
    Running the test with following options:
    Number of threads: 4
    Report intermediate results every 3 second(s)
    Initializing random number generator from current time
    
    Initializing worker threads...
    
    Threads started!
    
    [ 3s ] thds: 4 tps: 805.14 qps: 16122.80 (r/w/o: 11286.63/3224.56/1611.61) lat (ms,95%): 7.70 err/s: 0.00 reconn/s: 0.00
    [ 6s ] thds: 4 tps: 891.19 qps: 17819.06 (r/w/o: 12475.28/3561.41/1782.37) lat (ms,95%): 7.43 err/s: 0.00 reconn/s: 0.00
    [ 9s ] thds: 4 tps: 838.69 qps: 16775.78 (r/w/o: 11742.98/3355.42/1677.38) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 12s ] thds: 4 tps: 855.24 qps: 17100.48 (r/w/o: 11969.37/3420.63/1710.48) lat (ms,95%): 7.84 err/s: 0.00 reconn/s: 0.00
    [ 15s ] thds: 4 tps: 856.08 qps: 17122.62 (r/w/o: 11987.13/3423.32/1712.16) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 18s ] thds: 4 tps: 834.35 qps: 16683.96 (r/w/o: 11678.20/3337.39/1668.36) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 21s ] thds: 4 tps: 836.93 qps: 16733.92 (r/w/o: 11712.34/3347.72/1673.86) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 24s ] thds: 4 tps: 849.73 qps: 17006.66 (r/w/o: 11906.93/3399.93/1699.80) lat (ms,95%): 8.13 err/s: 0.00 reconn/s: 0.00
    [ 27s ] thds: 4 tps: 847.67 qps: 16953.77 (r/w/o: 11865.41/3393.02/1695.34) lat (ms,95%): 7.43 err/s: 0.00 reconn/s: 0.00
    [ 30s ] thds: 4 tps: 841.00 qps: 16808.31 (r/w/o: 11765.98/3360.66/1681.66) lat (ms,95%): 8.58 err/s: 0.00 reconn/s: 0.00
    [ 33s ] thds: 4 tps: 811.29 qps: 16238.80 (r/w/o: 11366.73/3249.16/1622.91) lat (ms,95%): 8.58 err/s: 0.00 reconn/s: 0.00
    [ 36s ] thds: 4 tps: 809.04 qps: 16175.85 (r/w/o: 11324.93/3232.84/1618.08) lat (ms,95%): 7.84 err/s: 0.00 reconn/s: 0.00
    [ 39s ] thds: 4 tps: 843.62 qps: 16870.73 (r/w/o: 11809.68/3373.81/1687.24) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 42s ] thds: 4 tps: 841.00 qps: 16826.31 (r/w/o: 11778.65/3365.66/1682.00) lat (ms,95%): 7.56 err/s: 0.00 reconn/s: 0.00
    [ 45s ] thds: 4 tps: 820.69 qps: 16411.52 (r/w/o: 11487.36/3282.77/1641.39) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 48s ] thds: 4 tps: 830.99 qps: 16623.45 (r/w/o: 11635.18/3326.29/1661.98) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 51s ] thds: 4 tps: 838.67 qps: 16763.33 (r/w/o: 11734.33/3352.00/1677.00) lat (ms,95%): 7.70 err/s: 0.00 reconn/s: 0.00
    [ 54s ] thds: 4 tps: 822.67 qps: 16456.73 (r/w/o: 11521.37/3289.68/1645.67) lat (ms,95%): 8.28 err/s: 0.00 reconn/s: 0.00
    [ 57s ] thds: 4 tps: 834.70 qps: 16696.98 (r/w/o: 11686.78/3340.80/1669.40) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    [ 60s ] thds: 4 tps: 834.58 qps: 16684.62 (r/w/o: 11679.47/3335.99/1669.16) lat (ms,95%): 7.98 err/s: 0.00 reconn/s: 0.00
    SQL statistics:
        queries performed:
            read:                            703290
            write:                           200940
            other:                           100470
            total:                           1004700
        transactions:                        50235  (837.05 per sec.)
        queries:                             1004700 (16740.90 per sec.)
        ignored errors:                      0      (0.00 per sec.)
        reconnects:                          0      (0.00 per sec.)
    
    General statistics:
        total time:                          60.0132s
        total number of events:              50235
    
    Latency (ms):
             min:                                    2.53
             avg:                                    4.78
             max:                                  131.93
             95th percentile:                        7.98
             sum:                               239893.00
    
    Threads fairness:
        events (avg/stddev):           12558.7500/336.17
        execution time (avg/stddev):   59.9732/0.00

参考链接 ：

MySQL性能半同步复制VS异步复制 ：  
https://mp.weixin.qq.com/s/DfB-cj3\_zQDXqhOSvJwtkQ

作者：老A  
地址：https://dbawsp.com/1873.html

[20201120160301626.png_pic_center]: /images/20221120/7e0497685bc84c1b9009d75a1fba411c.png
[20201120160315794.png_pic_center]: /images/20221120/cbef1f9311764374aedf463b13ac13a1.png
[20201120160442429.png_pic_center]: /images/20221120/3a66b14bc9664d21a9231846b4987afe.png