ZABBIX工作流程配置与自定义监控项

痛定思痛。 2023-02-27 13:54 12阅读 0赞

### ZABBIX工作流程与自定义监控项 ###

*  
 *   *  
     *   *  
     *  解决zabbix中文乱码问题
     *  1.创建主机组
     *  2.添加监控项
     *   *   *   *  A.用模板添加
                 *  B.用手动方式
     *  3.添加触发器
     *  4.添加媒介
     *  5.添加动作
     *   *  其他添加媒介动作的方法
         *   *  1.使用脚本
             *  2.配置文件mail.rc
     *  自定义监控项
     *   *  1.自定义监控日志
         *  2.自定义监控 MySQL主从
         *  3.自定义监控 MySQL延迟
     *  给监控项加声音
 *  Zabbix常用监控项

#  #

##  ##

###  ###

1.安装zabbix客户端
    
    [root@192 zabbix-5.0.1]# yum install gcc  pcre*
    
    [root@192 zabbix-5.0.1]# ./configure --enable-agent
    [root@192 zabbix-5.0.1]# make install
    
    [root@192 zabbix-5.0.1]# useradd -r -M -s /sbin/nologin zabbix
    
    [root@192 zabbix-5.0.1]# vim /usr/local/etc/zabbix_agentd.conf
    Server=192.168.30.226
    ServerActive=192.168.30.22
    Hostname=001
    
    
    [root@192 zabbix-5.0.1]# zabbix_agentd 
    [root@192 zabbix-5.0.1]# ss -anlt
    State       Recv-Q Send-Q Local Address:Port               Peer Address:Port              
    LISTEN      0      128              *:22                           *:*                  
    LISTEN      0      128              *:10050                        *:*                  
    LISTEN      0      128             :::22                          :::*             
    
    
    
    **服务端**
    可以取到值
    [root@zyy180 ~]# zabbix_get -s 192.168.30.178 -k vfs.file.cksum[/tmp/zyy]
    621795530

## 解决zabbix中文乱码问题 ##

**将自己电脑上的字体导出来**  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70]  
   
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 1]  
   
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 2]  
   
**源码安装，将文件拖进这个位置，并改名MSYHBD**  
![在这里插入图片描述][20201207101503584.png]  
   
![在这里插入图片描述][20201207101710212.png]  
   
![在这里插入图片描述][20201207101723345.png]  
   
![在这里插入图片描述][20201207101823549.png]  
   
**图表没有乱码**  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 3]

## 1.创建主机组 ##

***1.右上角创建***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 4]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 5]  
   
   
***2.添加主机***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 6]  
   
**Host name要与配置文件一致**  
**右上角添加**  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 7]

## 2.添加监控项 ##

##### A.用模板添加 #####

***1.右上角创建主机的第二列***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 8]

***2.查看图形***  
*点一下IP,在弹框里点Graphs*  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 9]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 10]

##### B.用手动方式 #####

***1.点ltems***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 11]

***2.右上角添加监控项***  
Type选择 Zabbix agent  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 12]  
   
   
***3.查看***\*  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 13]

## 3.添加触发器 ##

***1.点击Tiggers***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 14]

***2.右上角添加***  
选择刚刚添加的监控项  
点击Add选择监控项要是使用的函数  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 15]  
   
   
***3.查看触发器***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 16]

## 4.添加媒介 ##

***1.媒体配置***  
SMTP server 是邮箱的服务器(到自己的邮箱网站下查看)  
STMP email 是 指定使用邮箱(希望那个邮箱发送邮件给你)  
password是pop3/smtp授权码  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 17]

***选择模板***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 18]

***2.创建一个用户***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 19]

***3.添加发送的mail***  
Type选择刚刚创建的媒介  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 20]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 21]

## 5.添加动作 ##

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 22]

1.***选择刚刚创建的用户和媒体***  
Add选择刚刚创建的用户  
Seed only to 选择刚刚创建的媒体  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 23]

***2.完成***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 24]  
   
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 25]

### 其他添加媒介动作的方法 ###

#### 1.使用脚本 ####

**在服务器端**
    
    [root@zyy180 yum.repos.d]# yum -y install mailx
    [root@zyy180 ~]# echo "666" |mail -s "111" zyy130988@163.com  //可以发邮件
     
    
    
     //设置脚本存放路径
    [root@zyy180 etc]# vim zabbix_server.conf     
    AlertScriptsPath=/usr/local/etc/zabbix/alertscripts
    
    
    [root@zyy180 etc]#mkdir  -p  /usr/local/etc/zabbix/alertscripts
    
    [root@zyy180 etc]#cd /usr/local/zabbix/alertscripts
    
    [root@zyy180 alertscripts]# vim sendmail.sh
    
    [root@zyy180 alertscripts]# chmod +x sendmail.sh 
    
    
    
    
    [root@zyy180 alertscripts]# vim sendmail.sh
    
    #!/bin/bash
    
    SUBJECT=$(echo -e $2 |tr "\r\n" "\n")
    MESSAGE=$(echo -e $1 |tr "\r\n" "\n")
    
    
    echo "$MESSAGE" | /usr/bin/mail  -s "SUBJECT" $3
    
    
    [root@zyy180 etc]# chown -R zabbix.zabbix zabbix
    
    重启服务

***1.配置媒介，选择Script(脚本***![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 26]  
   
   
***2.选择参数***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 27]

***3.选择刚创建的媒介***  
Edit修改 Type改为刚刚创建的媒介  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 28]

***4.修改动作***  
send only to 选择刚刚创建的媒介  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 29]

***5.完成***![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 30]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 31]

#### 2.配置文件mail.rc ####

[root@zyy180 alertscripts]# vim /etc/mail.rc   //更改邮件的配置文件
    
    set from=zyy130988@163.com
    set smtp="smtp.163.com"
    set smtp-auth-user=zyy130988@163.com
    set smtp-auth-password=DJAVQTYYZRYYTYKU
    set smtp-auth=login
    
    
    [root@zyy180 alertscripts]# systemctl restart postfix   //重新启动

***1.添加媒介***![请添加图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 32]  
   
   
***2.完成***![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 33]

## 自定义监控项 ##

**客户端**
    
    1.创建一个脚本存放目录
    [root@192 ~]# mkdir /scripts/
    [root@192 ~]# cd /scripts/
    
    
    2.创建脚本文件
    [root@192 scripts]# vim check_process.sh 
    
    #!/bin/bash
    
    process_status=$(ps -ef|grep  $1 |grep -Ev "grep|$0" | wc -l )
    
    if [ $process_status -eq 0 ];then
        echo '1'
    else 
        echo '0'
    
    fi
    
    
    3.给执行权限
    [root@192 scripts]# chmod +x check_process.sh 
    
    
    
    
    4.修改配置文件启动功能，启动功能
    
    [root@192 scripts]# vim /usr/local/etc/zabbix_agentd.conf
    
    UnsafeUserParameters=1
    
    UserParameter=check_process[*],/bin/bash    /scripts/check_process.sh  $1
                      key         用/bin/bash执行   脚本位置                参数
    
    
    
    
    5.重启服务
    [root@192 etc]# pkill zabbix
    [root@192 etc]# zabbix_agentd 
    
    
    
    **服务端**
    [root@zyy180 etc]# zabbix_get -s 192.168.30.178 -k check_process[vim]
    0

***1.添加监控项***  
key要写配置文件里的  
有函数就在\[写进来\]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 34]

***2.查看监控项***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 35]

***3.查看监控项的状态值***  
右上角更改View as  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 36]

***4.添加触发器***

***ltem选择刚刚添加的监控项***  
**Resuit=1** (等于1就触发)  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 37]

***5.完成***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 38]

### 1.自定义监控日志 ###

***1.配置客户端文件***

1.将脚本下载下来
    https://github.com/chendao2015/pyscripts
    
    
    
    2.cp到脚本目录下
    [root@localhost ~]# unzip pyscripts-master.zip
    [root@localhost ~]# cd pyscripts-master
    [root@localhost pyscripts-master]mv log.py /scripts/
    
    
    
    3.更改配置文件
    [root@localhost ~]# vim /usr/local/etc/zabbix_agentd.conf
    UserParameter=log_information[*],/usr/bin/python /scripts/log.py $1 $2 $3
    
    
    
    4.在服务端测试
    [root@zyy180 ~]# zabbix_get -s 192.168.30.230 -k log_information[/var/log/secure,/tmp/logseek,Failed]
    1
    
    
    tail -f  实时查看日志

***2.添加监控项***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 39]  
   
***3.添加触发器***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 40]  
   
***4.完成***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 41]  
   
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 42]

### 2.自定义监控 MySQL主从 ###

***1.配置文件***

**在1号客户端安装mysql**
    **在2号客户端上安装mysql与zabbix客户端**
    **1号客户端和2号客户端将主从配好**
    
    
    1.在2号客户端创建脚本目录(与1号客户端一致)
    [root@yyslave ~]# mkdir /scripts
    [root@yyslave ~]#cd /scripts/
    
    
    
    
    
    2.编写脚本
    [root@yyslave scripts]# vim master_slave.sh 
    
    #!/bin/bash
    
    master_slave=$( /usr/bin/mysql  -uroot -e 'show slave status\G;' 2>/dev/null | grep "Slave.*Running" | grep -c 'Yes' )
    
    if [ $master_slave -eq 2 ];then
        echo "0"
    else
        echo "1"
    fi
    
    
    
    
    3.更改配置文件
    [root@yyslave scripts]# vim /usr/local/etc/zabbix_agentd.conf
    UnsafeUserParameters=1
    UserParameter=master_slave,/usr/bin/bash /scripts/master_slave.sh
    
    
    
    
    4.重启服务
    [root@yyslave ~]# pkill zabbix
    [root@yyslave ~]# zabbix_agentd 
    
    
    
    
    5.在服务端测试
    [root@zyy180 ~]# zabbix_get -s 192.168.30.231 -k master_slave 
    0

***2.添加监控项***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 43]  
   
***3.添加触发器***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 44]  
   
***4.完成***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 45]  
   
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 46]

### 3.自定义监控 MySQL延迟 ###

***1.更改配置文件***

1.进入脚本目录，编写目录
    [root@yyslave scripts]# vim database_delay.sh 
    #!/bin/bash
    
    
    
    delay=$( /usr/bin/mysql -uroot -e 'show slave status\G;' 2>/dev/null | grep 'Seconds_Behind_Master' | awk -F ': '\+ '{print $2}' )
    
    if [ $delay -eq 0 ];then
        echo "0"
    else
        echo "1"
    fi
    
    
    
    
    2.更改配置文件
    [root@yyslave scripts]# vim /usr/local/etc/zabbix_agentd.conf
    UserParameter=database_delay,/usr/bin/bash /scripts/database_delay.sh
    
    
    
    
    3.重启服务
    [root@yyslave scripts]# pkill zabbix
    [root@yyslave scripts]# zabbix_agentd 
    
    
    
    
    4.服务端测试
    [root@zyy180 ~]# zabbix_get -s 192.168.30.231 -k database_delay 
    0

***2.添加监控项***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 47]  
   
***3.添加触发器***  
这里应该是>0 ,  
但为了试验效果所以 表达式=0  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 48]

***4.完成***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 49]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 50]

## 给监控项加声音 ##

***点击User settings,在点击第三个选项***  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 51]

# Zabbix常用监控项 #

Windons系统：

<table> 
 <thead> 
  <tr> 
   <th>项目</th> 
   <th>items</th> 
   <th>items说明</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>内存</td> 
   <td>vm.memory.size[free]<br>vm.memory.size[total]</td> 
   <td>系统可用内存量 <br>系统总共内存量</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>swap空间</td> 
   <td>system.swap.size[,free] <br>system.swap.size[,total]</td> 
   <td><br>swap情况</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td></td> 
   <td>system.cpu.util[,avg1]</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,avg5]</td> 
   <td>系统CPU平均5min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,avg15]</td> 
   <td>系统CPU平均15min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg1]</td> 
   <td>系统CPU总负载/在线cpu个数平均1min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg5]</td> 
   <td>系统CPU总负载/在线cpu个数平均5min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg15]</td> 
   <td>系统CPU总负载/在线cpu个数平均15min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>perf_counter[“\Processor(_Total)% User Time”]</td> 
   <td>系统CPU使用时间百分比情况</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>perf_counter[“\Processor(_Total)% Processor Time”]</td> 
   <td>系统CPU使用负载百分比情况</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>磁盘空间（可用量）</td> 
   <td>vfs.fs.size[{#FSNAME},free]</td> 
   <td>可用磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（使用百分比）</td> 
   <td>vfs.fs.size[{#FSNAME},pfree]</td> 
   <td>可用磁盘空间大小占分区总磁盘空间的百分比</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（总量）</td> 
   <td>vfs.fs.size[{#FSNAME},total]</td> 
   <td>分区总磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（使用量）</td> 
   <td>vfs.fs.size[{#FSNAME},used]</td> 
   <td>已使用磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>I/O (读)</td> 
   <td>perf_counter[\2\16]</td> 
   <td>磁盘读取量 （bytes）</td> 
  </tr> 
  <tr> 
   <td>I/O (写)</td> 
   <td>perf_counter[\2\18]</td> 
   <td>磁盘写入量 （bytes）</td> 
  </tr> 
  <tr> 
   <td>I/O (读队列)</td> 
   <td>perf_counter[\234(_Total)\1402]</td> 
   <td>磁盘读取队列数</td> 
  </tr> 
  <tr> 
   <td>I/O (写队列)</td> 
   <td>perf_counter[\234(_Total)\1404]</td> 
   <td>磁盘写入队列数</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>网络流量（进口）</td> 
   <td>net.if.in[{#IFNAME}]</td> 
   <td>网络进接口流量 （bps）</td> 
  </tr> 
  <tr> 
   <td>网络流量（出口）</td> 
   <td>net.if.out[{#IFNAME}]</td> 
   <td>网络出接口流量 （bps）</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>proc.num[]</td> 
   <td>系统中总进程数量</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>perf_counter[\2\250]</td> 
   <td>系统中线程的数量</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.localtime</td> 
   <td>系统时间</td> 
  </tr> 
  <tr> 
   <td><br><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.ping</td> 
   <td>检查客户端可用性</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.version</td> 
   <td>检查客户端使用版本</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>system.uname</td> 
   <td>系统详细信息</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>system.uptime</td> 
   <td>系统开启持续时间</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.hostname</td> 
   <td>客户端主机名</td> 
  </tr> 
  <tr> 
   <td><br><br></td> 
   <td><br></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>程序内存/虚拟内存</td> 
   <td>proc_info[&lt;process&gt;,&lt;attribute&gt;,&lt;type&gt;]</td> 
   <td>程序内存、虚拟内存监控：<br>process - process name<br>attribute - requested process<br> attribute（vmsize,wkset内存）<br>type -min，max，avg，sum<br>eg:proc_info[NewImport.exe,vmsize,sum]<br> NewImport.exe的内存使用情况</td> 
  </tr> 
  <tr> 
   <td>程序PID监控</td> 
   <td>perf_counter[counter,]</td> 
   <td>监控程序Pid<br>counter-“\Process(reportserver)\ID Process”</td> 
  </tr> 
 </tbody> 
</table>

Linux系统：

<table> 
 <thead> 
  <tr> 
   <th>项目</th> 
   <th>items</th> 
   <th>items说明</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>内存</td> 
   <td>vm.memory.size[available]</td> 
   <td>系统中已用内存量</td> 
  </tr> 
  <tr> 
   <td>内存</td> 
   <td>vm.memory.size[total]</td> 
   <td>系统总共内存量</td> 
  </tr> 
  <tr> 
   <td>swap空间</td> 
   <td>system.swap.size[,free] <br>system.swap.size[,pfree]<br>system.swap.size[,total]</td> 
   <td></td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.switches</td> 
   <td>系统文件切换 （bps）</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,user]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,nice]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,system]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,iowait]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,idle]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,interrupt]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,steal]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.util[,softirq]</td> 
   <td>类似于对应系统中top命令查看CPU显示值</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg1]</td> 
   <td>系统CPU总负载/在线cpu个数平均1min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg5]</td> 
   <td>系统CPU总负载/在线cpu个数平均5min的利用百分比</td> 
  </tr> 
  <tr> 
   <td>CPU</td> 
   <td>system.cpu.load[percpu,avg15]</td> 
   <td>系统CPU总负载/在线cpu个数平均15min的利用百分比</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>磁盘空间（可用量）</td> 
   <td>vfs.fs.size[{#FSNAME},free]</td> 
   <td>可用磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（使用百分比）</td> 
   <td>vfs.fs.size[{#FSNAME},pfree]</td> 
   <td>可用磁盘空间大小占分区总磁盘空间的百分比</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（总量）</td> 
   <td>vfs.fs.size[{#FSNAME},total]</td> 
   <td>分区总磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（使用量）</td> 
   <td>vfs.fs.size[{#FSNAME},used]</td> 
   <td>已使用磁盘空间大小</td> 
  </tr> 
  <tr> 
   <td>磁盘空间（节点数占用）</td> 
   <td>vfs.fs.inode[{#FSNAME},pfree]</td> 
   <td>可用磁盘节点数占总节点数的百分比</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>网络流量（进口）</td> 
   <td>net.if.in[{#IFNAME}]</td> 
   <td>网络进接口流量 （bps）</td> 
  </tr> 
  <tr> 
   <td>网络流量（出口）</td> 
   <td>net.if.out[{#IFNAME}]</td> 
   <td>网络出接口流量 （bps）</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>proc.num[]</td> 
   <td>系统中总进程数量，通过top查看</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>proc.num[,run]</td> 
   <td>系统中处于running的进程，通过top查看</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.localtime</td> 
   <td>系统时间</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>vfs.file.cksum[/etc/passwd]</td> 
   <td>系统文件passwd的文件总数</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.boottime</td> 
   <td>系统启动的时间戳</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.hostname</td> 
   <td>系统名称</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.cpu.intr</td> 
   <td>设备中断</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>kernel.maxfiles</td> 
   <td>系统支持打开文件的最大数量</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>kernel.maxproc</td> 
   <td>系统支持打开进程的最大数量</td> 
  </tr> 
  <tr> 
   <td>系统</td> 
   <td>system.users.num</td> 
   <td>登陆系统的用户数</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.ping</td> 
   <td>检查客户端可用性</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.version</td> 
   <td>检查客户端使用版本</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>system.uname</td> 
   <td>系统详细信息</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>system.uptime</td> 
   <td>系统开启持续时间</td> 
  </tr> 
  <tr> 
   <td>Agent</td> 
   <td>agent.hostname</td> 
   <td>客户端主机名</td> 
  </tr> 
  <tr> 
   <td><br></td> 
   <td></td> 
   <td></td> 
  </tr> 
  <tr> 
   <td>端口</td> 
   <td>net.tcp.listen[port]</td> 
   <td>监控程序端口启用</td> 
  </tr> 
 </tbody> 
</table>

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70]: /images/20230209/150d155bb67d4a34af33dbf943adcff8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 1]: /images/20230209/6a170627dcb14eaa8a272f938b2c5bb5.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20201207101222527.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[20201207101503584.png]: https://img-blog.csdnimg.cn/20201207101503584.png
[20201207101710212.png]: https://img-blog.csdnimg.cn/20201207101710212.png
[20201207101723345.png]: https://img-blog.csdnimg.cn/20201207101723345.png
[20201207101823549.png]: https://img-blog.csdnimg.cn/20201207101823549.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20201207101908328.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 4]: https://img-blog.csdnimg.cn/20200719114757636.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 5]: https://img-blog.csdnimg.cn/20200718210649563.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 6]: https://img-blog.csdnimg.cn/20200719114904514.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 7]: https://img-blog.csdnimg.cn/20200718194712731.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 8]: https://img-blog.csdnimg.cn/20200719115121159.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 9]: https://img-blog.csdnimg.cn/20200719115305832.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 10]: https://img-blog.csdnimg.cn/20200718200319984.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 11]: https://img-blog.csdnimg.cn/20200719115431810.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 12]: https://img-blog.csdnimg.cn/20200718200642241.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 13]: https://img-blog.csdnimg.cn/20200718200923707.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 14]: https://img-blog.csdnimg.cn/20200719115552225.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 15]: https://img-blog.csdnimg.cn/20200718201152131.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 16]: https://img-blog.csdnimg.cn/20200718201512878.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 17]: https://img-blog.csdnimg.cn/20200720123024684.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 18]: https://img-blog.csdnimg.cn/20200720101729941.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 19]: https://img-blog.csdnimg.cn/20200719115655239.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 20]: https://img-blog.csdnimg.cn/20200720123128271.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 21]: https://img-blog.csdnimg.cn/20200720123140676.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 22]: https://img-blog.csdnimg.cn/20200720100443508.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 23]: https://img-blog.csdnimg.cn/20200720123320906.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 24]: https://img-blog.csdnimg.cn/20200718202810634.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 25]: https://img-blog.csdnimg.cn/20200720123349555.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 26]: https://img-blog.csdnimg.cn/20200718204529440.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 27]: https://img-blog.csdnimg.cn/2020071912042582.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 28]: https://img-blog.csdnimg.cn/20200719120525294.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 29]: https://img-blog.csdnimg.cn/20200719120658371.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 30]: https://img-blog.csdnimg.cn/20200718204905347.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 31]: https://img-blog.csdnimg.cn/20200718204917804.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 32]: https://img-blog.csdnimg.cn/20200718205106936.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 33]: https://img-blog.csdnimg.cn/20200718205148206.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 34]: https://img-blog.csdnimg.cn/20200719120932749.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 35]: https://img-blog.csdnimg.cn/20200719121026696.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 36]: https://img-blog.csdnimg.cn/20200718205742780.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 37]: https://img-blog.csdnimg.cn/20200719121118125.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 38]: https://img-blog.csdnimg.cn/20200718210041543.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 39]: https://img-blog.csdnimg.cn/20200721122732972.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 40]: https://img-blog.csdnimg.cn/20200721122842168.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 41]: https://img-blog.csdnimg.cn/20200721122913219.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 42]: https://img-blog.csdnimg.cn/20200721122923497.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 43]: https://img-blog.csdnimg.cn/20200721123121916.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 44]: https://img-blog.csdnimg.cn/20200721123232620.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 45]: https://img-blog.csdnimg.cn/2020072112324786.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 46]: https://img-blog.csdnimg.cn/2020072112325616.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 47]: https://img-blog.csdnimg.cn/20200721123408450.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 48]: https://img-blog.csdnimg.cn/20200722181730515.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 49]: https://img-blog.csdnimg.cn/20200722181750509.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 50]: https://img-blog.csdnimg.cn/20200722181801371.PNG?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA_size_16_color_FFFFFF_t_70 51]: https://img-blog.csdnimg.cn/20200721125820147.jpg?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3p5eTEzMDk4OA==,size_16,color_FFFFFF,t_70