Docker（九）---docekr三剑客（machine、compose、swarm）

绝地灬酷狼 2021-11-04 15:38 245阅读 0赞

## 一.简介 ##

**1.Docker Machine**

*  Docker Machine 是 Docker 官方编排（Orchestration）项目之一，负责在多种平台上快速安装 Docker环境。
 *  Docker Machine支持在常规Linux操作系统、虚拟化平台、openstack、公有云等不同环境下安装配置docker  
    host。
 *  Docker Machine 项目基于 Go 语言实现，目前在 Github 上的维护地址：  
    https://github.com/docker/machine/

**2.Docker compose**

*  compose 是用来定义和运行一个或多个容器(通常都是多个)运行和应用的工具。使用 compose可以简化容器镜像的构建以及容器的运行。
 *  compose 使用 YAML 文件来定义多容器之间的关系。一个 docker-compose up 就可以把完整的应用跑起来。 本质上， compose 把 YAML 文件解析成 docker 命令的参数，然后调用相应的 docker命令行接口，从而将应用以容器化的方式管理起来。它通过解析容器间的依赖关系顺序地启动容器。而容器间的依赖关系由 YAML 文件中的 links 标记指定。

**3.Docker Swarm**

*  Swram是Docker公司推出的官方容器集群平台，基于go语言实现，代码开源在  
    https://github.com/docker/swarm .2016年2月对架构进行重新设计，推出了v2版本，支持超过1千个节点。作为容器集群管理器，Swarm最大的优势之一就是100%支持标准的DockerAPI及工具（如Compose，docker-py等），Docker本身就可以很好地与Swarm进行集成。

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70]

*  Manager：接收客户端服务定义，将任务发送到agnet节点，维护集群期望状态和集群管理功能以及leader选举。默认情况下manager节点也会运行任务，也可以配置只做管理任务。
 *  agent：接收并执行从管理节点分配的任务，并报告任务当前的状态，以便Manager节点维护每个服务期望状态。

## 二.创建docker-machine ##

1.在server1上面部署docker-machine，下载二进制可执行文件，重命名并授予执行权限。

[root@server1 ~]# mv docker-machine-Linux-x86_64-0.16.1 /usr/local/bin
    [root@server1 ~]# mv /usr/local/bin/docker-machine-Linux-x86_64-0.16.1 /usr/local/bin/docker-machine
    [root@server1 ~]# chmod +x /usr/local/bin/docker-machine 
    [root@server1 ~]# docker-machine --v		##查看版本号
    [root@server1 ~]# docker-machine --help

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 1]  
2.查看本机docker版本（后面会用到）

[root@server1 ~]# docker version

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 2]

3.免密登陆

[root@server1 ~]# ssh-keygen 
    [root@server1 ~]# ssh-copy-id server2:
    [root@server1 ~]# ssh-copy-id server3:

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 3]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 4]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 5]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 6]

4.让真机从互联网上拉取get.docker.com

[root@foundation11 html]# wget https://get.docker.com/

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 7]

5.修改index.html  
![在这里插入图片描述][20190813224549190.png]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 8]

6.修改server2、server3的发行版本号和yum配置文件

[root@server2 yum.repos.d]# vim /etc/os-release 
    [root@server2 yum.repos.d]# vim /etc/yum.conf

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 9]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 10]  
7.给server2和server3自动部署docker。

[root@server1 ~]# docker-machine create --driver generic  --engine-install-url="http://172.25.16.250" --generic-ip-address=172.25.16.2 server2
    [root@server1 ~]# docker-machine create --driver generic  --engine-install-url="http://172.25.16.250" --generic-ip-address=172.25.16.2 server3

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 11]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 12]  
若安装过程出现错误，需删除删除server2生成的.repo文件

[root@server1 ~]# docker-machine ls
    [root@server1 ~]# docker-machine rm server

server2和server3生成的配置文件：  
从配置文件中可以看出，docker daemon启用了TLS验证功能，docker-machine已经为其生成好了所需的证书文件。

[root@server2 ~]# cat /etc/systemd/system/docker.service.d/10-machine.conf
    [root@server3 ~]# cat /etc/systemd/system/docker.service.d/10-machine.conf

![在这里插入图片描述][20190813230209973.png]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 13]

## 三.管理docker-machine ##

1.显示访问server2和server3主机的所需的环境变量信息。

[root@server1 ~]# docker-machine env server2
    [root@server1 ~]# docker-machine env server3

![在这里插入图片描述][20190813231113780.png]

连接远程docker主机时需要执行以下命令

[root@server1 ~]# docker -H tcp://172.25.16.2:2376 ps

![在这里插入图片描述][20190813231158577.png]  
3.安装bash脚本

[root@server1 ~]# cd /etc/bash_completion.d/
    [root@server1 bash_completion.d]# ls
    docker-machine.bash          rct                          rhsm-debug
    docker-machine-prompt.bash   redefine_filedir             rhsm-icon
    docker-machine-wrapper.bash  rhn-migrate-classic-to-rhsm  subscription-manager
    iprutils                     rhsmcertd
    [root@server1 bash_completion.d]# source docker-machine.bash 
    [root@server1 bash_completion.d]# source docker-machine-prompt.bash 
    [root@server1 bash_completion.d]# source docker-machine-wrapper.bash

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 14]  
4.编辑环境，并测试

[root@server1 ~]# vim .bashrc 
    [root@server1 ~]# source .bashrc 
    [root@server1 ~]# docker-machine use server2
    Active machine: server2
    [root@server1 ~ [server2]]# docker-machine use -u		#切会server1
    Active machine: 
    [root@server1 ~]# cat .bashrc 
    # .bashrc
    
    # User specific aliases and functions
    
    alias rm='rm -i'
    alias cp='cp -i'
    alias mv='mv -i'
    
    # Source global definitions
    if [ -f /etc/bashrc ]; then
    	. /etc/bashrc
    fi
    PS1='[\u@\h \W$(__docker_machine_ps1)]\$ '      ##添加的内容
    [root@server1 ~]#

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 15]  
docker-machine常见命令：

docker-machine upgrade  server2	更新docker版本
    docker-machine config  server2	查看machine配置
    docker-machine scp 			可以在machine中复制文件
    docker-machine ssh			连接machine
    docker-machine rm			删除machine

## 四.docker-compose ##

root@server1 ~]# docker-compose 		##tap
    .bash_logout
    .bash_profile
    .bashrc
    containerd.io-1.2.5-3.1.el7.x86_64.rpm
    container-selinux-2.21-1.el7.noarch.rpm
    .cshrc
    docker-ce-18.09.7-3.el7.x86_64.rpm
    docker-ce-cli-18.09.7-3.el7.x86_64.rpm
    index.html
    libsemanage-2.5-8.el7.x86_64.rpm
    libsemanage-python-2.5-8.el7.x86_64.rpm
    pigz-2.3.4-1.el7.x86_64.rpm
    policycoreutils-2.5-17.1.el7.x86_64.rpm
    policycoreutils-python-2.5-17.1.el7.x86_64.rpm
    .ssh/
    .tcshrc
    .viminfo

[root@server1 ~]# cd /mnt
    [root@server1 mnt]# ls
    [root@server1 mnt]# mkdir compose

导入haproxy镜像

[root@server1 ~]# docker load -i haproxy.tar 
    [root@server1 ~]# docker history haproxy:latest

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 16]

[root@server1 ~]# cd /mnt/compose/
    [root@server1 compose]# ls
    [root@server1 compose]# vim docker-compose.yml

文件内容如下：

web1:
            image: nginx
            expose:
                    - 80
            volumes:
                    - ./web1:/usr/share/nginx/html
    web2:
            image: nginx
            expose :
                    - 80
    haproxy:
            image: haproxy:lastest
            volumes:
                    - ./haproxy/haproxy.cfg:/usr/local/etc/haproxy/haproxy.cfg:ro
            links:
                    - web1
                    - web2
            ports:
                    - "80:80"
            expose:
                    - "80"

编辑配置文件

vim haproxy.cfg

global
    log 127.0.0.1 local0
    global
            log 127.0.0.1 local0
            log 127.0.0.1 local1 notice
    defaults
            log global
            mode http
            option httplog
            option dontlognull
            timeout connect 5000ms
            timeout client 50000ms
            timeout server 50000ms
            stats uri /status
    frontend balancer
            bind 0.0.0.0:80
            default_backend web_backends
    backend web_backends
            balance roundrobin
            server server1 web1:80 check
            server server2 web2:80 check

测试：出现轮询

## 五.Swam管理集群 ##

1.部署集群

1.清理实验环境  
删除server1、server2的容器  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 17]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 18]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 19]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 20]

2.为server3安装docker（server1、server2已经安装好了）

[root@server1 ~]# scp -r docker server3:
    [root@server3 ~]# ls
    docker
    [root@server3 ~]# cd docker/
    [root@server3 docker]# ls
    container-selinux-2.21-1.el7.noarch.rpm
    docker-ce-18.06.1.ce-3.el7.x86_64.rpm
    libsemanage-2.5-8.el7.x86_64.rpm
    libsemanage-python-2.5-8.el7.x86_64.rpm
    pigz-2.3.4-1.el7.x86_64.rpm
    policycoreutils-2.5-17.1.el7.x86_64.rpm
    policycoreutils-python-2.5-17.1.el7.x86_64.rpm
    repodata
    [root@server3 docker]# yum install *.rpm -y

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 21]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 22]  
3.打开server3的docker服务

[root@server3 docker]# systemctl start docker.service

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 23]4.初始化server1（管理节点）的swarm集群

[root@server1 ~]# docker swarm init

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 24]5.查看server1的桥接，和网络信息

[root@server1 ~]# yum install bridge-utils.x86_64 -y					##提供brctl命令
    [root@server1 ~]# brctl show
    [root@server1 ~]# docker network ls

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 25]  
6.server2、server3加入集群

[root@server2 docker]# docker swarm join --token SWMTKN-1-5m3v8gviqk7r5e1zs9h8vsr16shhti2mp1o5qa23i7tgml08ut-bqrt2diawswa860qqmabblw4x 172.25.16.1:2377
    [root@server2 docker]# docker swarm join --token SWMTKN-1-5m3v8gviqk7r5e1zs9h8vsr16shhti2mp1o5qa23i7tgml08ut-bqrt2diawswa860qqmabblw4x 172.25.16.1:2377

7.在管理节点查看到所有节点信息和状态

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 26]

2.部署应用

1.server1中创建网络webnet，用于容器间通信。

[root@server1 ~]# docker service create --name web --network webnet --publish 80:80 --replicas 3 nginx:1.16 
    ##-replicas 3代表集群的个数为3;nginx后面要带版本号，默认是laster（可以修改标签）
    image nginx:1.16 could not be accessed on a registry to record
    its digest. Each node will access nginx:1.16 independently,
    possibly leading to different nodes running different
    versions of the image.
    
    qchyxe0yjm7005e8rb2l5f9fz
    overall progress: 3 out of 3 tasks 
    1/3: running   
    2/3: running   
    3/3: running   
    verify: Service converged 
    [root@server1 ~]#

2.查看服务列表

[root@server1 ~]# docker service ls
    [root@server1 ~]# docker service ps web

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 27]  
![在这里插入图片描述][20190807214728336.png]![在这里插入图片描述][2019080721475125.png]  
4.给server3加载nginx镜像  
![在这里插入图片描述][20190807214854360.png]  
5.扩容（增加到六个负载）

[root@server1 ~]# docker service scale web=6
    web scaled to 6
    overall progress: 6 out of 6 tasks 
    1/6: running   
    2/6: running   
    3/6: running   
    4/6: running   
    5/6: running   
    6/6: running   
    verify: Service converged

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 28]6.缩减到3个（够用就行）

[root@server1 ~]# docker service scale web=3
    web scaled to 3
    overall progress: 3 out of 3 tasks 
    1/3: running   
    2/3: running   
    3/3: running   
    verify: Service converged

此时每个主机开启一个nginx服务  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 29]  
7.在三个虚拟机上编写nginx发布默认文件，并cp到容器内nginx的html下  
![在这里插入图片描述][20190807215947358.png]  
![在这里插入图片描述][20190807215952412.png]![在这里插入图片描述][20190807220009987.png]

测试：

物理机中访问三台虚拟机，成功访问并实现轮询

[root@foundation60 ~]# for i in {1..10};do curl 172.25.16.2/index.html;done
    [root@foundation60 ~]# for i in {1..10};do curl 172.25.16.2/index.html;done
    [root@foundation60 ~]# for i in {1..10};do curl 172.25.16.3/index.html;done

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 30]![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 31]

3.部署监控  
1.在每个节点上导入visualizer.tar镜像

[root@server1 ~]# docker load -i visualizer.tar

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 32]

[root@server2 ~]# docker load -i visualizer.tar

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 33]

[root@server3 ~]# docker load -i visualizer.tar

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 34]  
2.创建swarm的监控容器，使监控和docker连接起来

[root@server1 ~]# docker service create --name=viz --publish=8080:8080/tcp --constraint=node.role==manager --mount=type=bind,src=/var/run/docker.sock,dst=/var/run/docker.sock dockersamples/visualizer

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 35]3.查看容器viz和8080端口开启情况  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 36]  
测试：

浏览器输入：172.25.16.1：8080

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 37]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70]: /images/20211104/31fd944cbf0c4316ad49e37a68b88186.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 1]: /images/20211104/f9f06f0d8781495083671e1d0a075aee.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 2]: /images/20211104/7b634386c773426d904b2ff31104a947.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 3]: /images/20211104/e48e7132ec364802b04e6679435d4dd3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 4]: /images/20211104/0b74301529fb4846b6b211b7661cda87.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 5]: /images/20211104/56aa9ce4201c44488161460eb15aa4be.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 6]: /images/20211104/540f0df549fb482799c377d286978f75.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 7]: /images/20211104/a6a9c8086aad4149928cef921f5fbad3.png
[20190813224549190.png]: https://img-blog.csdnimg.cn/20190813224549190.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 8]: /images/20211104/a90fbde0b6b946b7aabf03f60db3a48d.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 9]: /images/20211104/c7f4dbfad55d4b1fbe5a2b8ac60fa535.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 10]: /images/20211104/9de8bda61ded4d93aaead6860efe2a31.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 11]: /images/20211104/77ae28e449b9470982dc4393430fcfed.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 12]: /images/20211104/96991e3be2cb441f940b5d99044e0720.png
[20190813230209973.png]: /images/20211104/a8eaad553ff84a4b80faaa1eee17624c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 13]: /images/20211104/0f77787bfaca4b038d2c8f6c0678629d.png
[20190813231113780.png]: /images/20211104/c4a8171784e043b5adfb804c39512732.png
[20190813231158577.png]: /images/20211104/1ee52bafa0da40bca4b7738788c25651.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 14]: /images/20211104/d54dcc8dab944eb5869409c439ad22e8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 15]: /images/20211104/af4a04b73f8d4e5ebc88729457697642.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 16]: /images/20211104/58a5fc6489e148e48323cd20de800298.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 17]: https://img-blog.csdnimg.cn/20190807205545304.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 18]: /images/20211104/a1c2e4ba3c284da99a4852c94b9df2e2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 19]: /images/20211104/b10eaf61f84441b89784ef3440f3e1a3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 20]: /images/20211104/88da9d7f2b95405589f225a4c00bd7f8.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 21]: /images/20211104/6e63eced51fa464db884e3f5fcde616a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 22]: /images/20211104/5efe733cc99741edaf2d2bfdf2f8485f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 23]: /images/20211104/69486104b90d433cba26ed3d9876226c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 24]: /images/20211104/d419bff79c7b47b5ad020bf53b2a9f4a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 25]: /images/20211104/21ec538856024af9b6c669c1680aba96.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 26]: /images/20211104/171e110689c64127840a53431cf0a63a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 27]: /images/20211104/631159353bd842d6a0484530d121d4e0.png
[20190807214728336.png]: https://img-blog.csdnimg.cn/20190807214728336.png
[2019080721475125.png]: /images/20211104/b3989407667a45d5970cb4976bc3b722.png
[20190807214854360.png]: /images/20211104/a474dc8b205149e18a87a9f386d4d976.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 28]: /images/20211104/b0d580dc03144a04897a4714b0dbeda4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 29]: /images/20211104/6fa97f2bbec444e48d87b3d56bd5a068.png
[20190807215947358.png]: /images/20211104/35a9c217f35743c9910699a9b523ae30.png
[20190807215952412.png]: https://img-blog.csdnimg.cn/20190807215952412.png
[20190807220009987.png]: /images/20211104/bd21d7f45984488c92e88518f33110c1.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 30]: https://img-blog.csdnimg.cn/2019080722041183.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg==,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 31]: /images/20211104/4166543a297b45628a2bc4a468e1e3c1.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 32]: /images/20211104/415e7d6f75e3428eac4df732f80edff1.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 33]: /images/20211104/277f4f2797724e02acf59c39086d757a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 34]: /images/20211104/76de9eb7e36b46eca270d4f0fe217a16.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 35]: /images/20211104/e777158e56e5475998d8cad0686a1361.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 36]: /images/20211104/83b5563f39aa4a41ae90ee9021b6dabd.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDg4OTYxNg_size_16_color_FFFFFF_t_70 37]: /images/20211104/33d6d95bed614ba4b1f15a19516ec73e.png