prometheus operator监控k8s集群之外的haproxy组件

╰半夏微凉° 2023-02-28 01:37 64阅读 0赞

## 微信公众号搜索DevOps和k8s全栈技术 ，即可关注我的公众号，也可通过扫描文章最后的二维码关注，每天都会分享技术文章供大家参考阅读~，拥抱开源，同大家共同进步~    ##

prometheus operator连载文章

[Prometheus Operator-上篇-安装和使用篇][Prometheus Operator-_-]

[Prometheus Operator-下篇][Prometheus Operator-]\-通过编写operator实现监控告警等

[Prometheus+Grafana+Alertmanager搭建全方位的监控告警系统-超详细文档][Prometheus_Grafana_Alertmanager_-]

[Prometheus监控Tomcat][Prometheus_Tomcat]

[Prometheus监控Nginx][Prometheus_Nginx]

[Prometheus监控MySQL][Prometheus_MySQL]

[Prometheus监控Redis][Prometheus_Redis]

## [报警神器Alertmanager发送报警到多个渠道][Alertmanager] ##

**安装haproxy**

在k8s的master1节点安装haproxy，k8s的master1节点的机器ip是192.168.0.6，haproxy1.8.6版本压缩包所在的百度网盘地址如下：

链接：https://pan.baidu.com/s/1glUeOwnvZrdnETr4KayNjg
    提取码：i3rn

把压缩包上传到自己的k8s master1节点，手动解压，然后编译安装：

tar zxvf haproxy-1.8.6.tar.gz

cd haproxy-1.8.6

make TARGET=linux31

make install PREFIX=/usr/local/haproxy

mkdir /usr/local/haproxy/conf

cp  examples/option-http\_proxy.cfg  /usr/local/haproxy/conf/haproxy.cfg

修改/usr/local/haproxy/conf/haproxy.cfg文件里的监听端口,把bind后面的值改成\*:5000，这个是haproxy的监听端口，大家可以随意改，符合自己的环境即可：

cat /usr/local/haproxy/conf/haproxy.cfg

![format_png][]

修改haproxy启动脚本文件：

在/etc/init.d/新建一个haproxy文件，haproxy文件所在百度网盘地址如下，

链接：https://pan.baidu.com/s/1zFxHftdAHob-Rtyizk10Xg
    提取码：u2lz

可从百度网盘下载，然后拷贝到自己haproxy机器的/etc/init.d/目录下：

具体内容也可以参考如下，建议直接从百度王盼盼下载，这样不会出现乱码问题：

cat  /etc/init.d/haproxy

#!/bin/sh

# chkconfig 2345 on

# description: HAProxy is a TCP/HTTP reverse proxy which is particularly suited for high availability environments.

if [ -f /etc/init.d/functions ]; then

. /etc/init.d/functions

elif [ -f /etc/rc.d/init.d/functions ] ; then

. /etc/rc.d/init.d/functions

else

exit 0

# Source networking configuration.

. /etc/sysconfig/network

# Check that networking is up.

[ ${NETWORKING} = "no" ] && exit 0

config="/usr/local/haproxy/conf/haproxy.cfg"

exec="/usr/local/haproxy/sbin/haproxy"

PID="/var/run/haproxy.pid"

[ -f $config ] || exit 1

RETVAL=0

start() {

daemon $exec -c -q -f $config

if [ $? -ne 0 ]; then

echo "Errors found in configuration file."

return 1

echo -n "Starting HAproxy: "

$exec -D -f $config -p $PID

RETVAL=$?

echo

[ $RETVAL -eq 0 ] && touch /var/lock/subsys/haproxy

return $RETVAL

}

stop() {

echo -n "Shutting down HAproxy: "

killproc haproxy -USR1

RETVAL=$?

echo

[ $RETVAL -eq 0 ] && rm -f /var/lock/subsys/haproxy

[ $RETVAL -eq 0 ] && rm -f $PID

return $RETVAL

}

restart() {

$exec -c -q -f $config

if [ $? -ne 0 ]; then

echo "Errors found in configuration file, check it with 'haproxy check'."

return 1

stop

start

}

rhstatus() {

status haproxy

}

# See how we were called.

case "$1" in

start)

start

;;

stop)

stop

;;

restart)

restart

;;

status)

rhstatus

;;

echo $"Usage: haproxy {start|stop|restart|status}"

RETVAL=1

esac

exit $RETVAL

**启动haproxy：**

chmod  +x  /etc/init.d/haproxy
    service  haproxy start

查看haproxy是否启动成功：

ss -antulp | grep :5000

显示如下，说明启动成功：

tcp    LISTEN     0      128       *:5000                  *:*                   users:(("haproxy",pid=61613,fd=3),("haproxy",pid=61612,fd=3),("haproxy",pid=61611,fd=3),("haproxy",pid=61610,fd=3))

**安装haproxy\_exporter**

**haproxy\_exporter需要的压缩包是：**

haproxy_exporter-0.9.0.linux-386.tar.gz

压缩包所在的百度网盘地址如下：

链接：https://pan.baidu.com/s/1zFxHftdAHob-Rtyizk10Xg
    提取码：u2lz

可从百度网盘把压缩包下载到电脑，然后上传到k8s的master1节点进行解压安装：

tar  zxvf  haproxy\_exporter-0.9.0.linux-386.tar.gz

cd   haproxy\_exporter-0.9.0.linux-386

`cp haproxy_exporter  /usr/bin`

` `

**启动haproxy\_exporter：**``

haproxy\_exporter --haproxy.scrape-uri="http://192.168.0.6:5000/baz?stats;csv" --web.listen-address="192.168.0.6:9100" &

**注意：**

192.168.0.6是部署haproxy和haproxy\_exporter所在机器的ip，5000端口是haproxy组件端口，9100是haproxy\_exporter端口

**验证haproxy\_exporter是否启动成功：**

ss -antulp | grep :9100

**显示如下，说明启动成功：**

tcp    LISTEN     0     128    192.168.0.6:9100                  *:*                   users:(("haproxy_exporte",pid=51714,fd=3))

**通过haproxy\_exporter采集haproxy组件监控指标：**

curl  192.168.0.6:9100/metrics

可看到如下监控指标数据：

# HELP go_gc_duration_seconds A summary of the GC invocationdurations.
    # TYPE go_gc_duration_seconds summary
    go_gc_duration_seconds{quantile="0"} 0.00011131
    go_gc_duration_seconds{quantile="0.25"} 0.000411065
    go_gc_duration_seconds{quantile="0.5"} 0.000803894
    go_gc_duration_seconds{quantile="0.75"} 0.002416707
    go_gc_duration_seconds{quantile="1"} 0.031029562
    go_gc_duration_seconds_sum 0.104676686
    go_gc_duration_seconds_count 19
    # HELP go_goroutines Number of goroutines that currently exist.
    # TYPE go_goroutines gauge
    go_goroutines 9
    # HELP go_memstats_alloc_bytes Number of bytes allocated and stillin use.
    # TYPE go_memstats_alloc_bytes gauge
    go_memstats_alloc_bytes 3.384024e+06
    # HELP go_memstats_alloc_bytes_total Total number of bytesallocated, even if freed.
    # TYPE go_memstats_alloc_bytes_total counter
    go_memstats_alloc_bytes_total 5.452464e+07
    # HELP go_memstats_buck_hash_sys_bytes Number of bytes used by theprofiling bucket hash table.
    # TYPE go_memstats_buck_hash_sys_bytes gauge
    go_memstats_buck_hash_sys_bytes 725494
    # HELP go_memstats_frees_total Total number of frees.
    # TYPE go_memstats_frees_total counter
    go_memstats_frees_total 81339
    # HELP go_memstats_gc_sys_bytes Number of bytes used for garbagecollection system metadata.
    # TYPE go_memstats_gc_sys_bytes gauge
    go_memstats_gc_sys_bytes 2.8383232e+07
    # HELP go_memstats_heap_alloc_bytes Number of heap bytes allocatedand still in use.
    # TYPE go_memstats_heap_alloc_bytes gauge
    go_memstats_heap_alloc_bytes 3.384024e+06
    # HELP go_memstats_heap_idle_bytes Number of heap bytes waiting tobe used.
    # TYPE go_memstats_heap_idle_bytes gauge
    go_memstats_heap_idle_bytes 1.39264e+06
    ---
    ---
    ---
    ---
    ---
    ---

**配置prometheus operator的servicemonitor实现对haproxy的监控**

在k8s的master1节点编写servicemonitor，所需要的yaml文件在百度网盘地址如下：

链接：https://pan.baidu.com/s/1zFxHftdAHob-Rtyizk10Xg
    提取码：u2lz

建议直接从百度网盘下载资源清单文件prometheus-servicemonitor-haproxy.yaml，然后传到k8s的master1节点，这样不会出现乱码问题，

也可参考下面内容：

cat prometheus-servicemonitor-haproxy.yaml

kind: Service
    apiVersion: v1
    metadata:
     name: haproxy
     labels:
       app: haproxy
    spec:
     type: ClusterIP
     ports:
     - name: haproxy
       port: 9100
       targetPort: 9100
    ---
    kind: Endpoints
    apiVersion: v1
    metadata:
     name: haproxy
     labels:
       app: haproxy
    subsets:
     - addresses:
         - ip: 192.168.0.6
       ports:
         - name: haproxy
           port: 9100
    ---
    apiVersion: monitoring.coreos.com/v1
    kind: ServiceMonitor
    metadata:
      name: haproxy
      namespace: monitoring
      labels:
        team: frontend
    spec:
      namespaceSelector:
        any: true
        matchNames:
        - default
      selector:
        matchLabels:
          app: haproxy
      endpoints:
      - port: haproxy
    targetPort: 9100

通过kubectl apply更新yaml：

kubectl apply  -f prometheus-servicemonitor-haproxy.yaml

**在prometheus的web界面查看是否监控到了haproxy数据，显示如下，说明配置正常：**

![format_png 1][]

![format_png 2][]

往期精彩文章

[kubernetes全栈技术+企业案例演示【带你快速掌握和使用k8s】][kubernetes_k8s]

[kubernetes面试题汇总][kubernetes]

[DevOps视频和资料免费领取][DevOps]

[kubernetes技术分享-可用于企业内部培训][kubernetes_-]

[谈谈我的IT发展之路][IT]

[kubernetes系列文章第一篇-k8s基本介绍][kubernetes_-k8s]

[kubernetes系列文章第二篇-kubectl][kubernetes_-kubectl]

[了解pod和pod的生命周期-这一篇文章就够了  
][pod_pod_-_]

[Kubernetes中部署MySQL高可用集群][Kubernetes_MySQL]

[Prometheus+Grafana+Alertmanager搭建全方位的监控告警系统-超详细文档][Prometheus_Grafana_Alertmanager_-]

[k8s1.18多master节点高可用集群安装-超详细中文官方文档][k8s1.18_master_-]

[k8s中蓝绿部署、金丝雀发布、滚动更新汇总][k8s]

[运维常见问题汇总-tomcat篇][-tomcat]

[关于linux内核参数的调优，你需要知道][linux]

[kubernetes持久化存储volume][kubernetes_volume]

[kubernetes挂载ceph rbd和cephfs][kubernetes_ceph rbd_cephfs]

[报警神器Alertmanager发送报警到多个渠道][Alertmanager]

[jenkins+kubernetes+harbor+gitlab构建企业级devops平台][jenkins_kubernetes_harbor_gitlab_devops]

[kubernetes网络插件-flannel篇][kubernetes_-flannel]

[kubernetes网络插件-calico篇][kubernetes_-calico]

[kubernetes认证、授权、准入控制][kubernetes 1]

[限制不同的用户操作k8s资源][k8s 1]

[面试真题&技术资料免费领取-覆盖面超全~][-]

[Prometheus监控MySQL][Prometheus_MySQL 1]

[Prometheus监控Nginx][Prometheus_Nginx 1]

[Prometheus监控Tomcat][Prometheus_Tomcat 1]

[linux面试题汇总][linux 1]

[测试通过storageclass动态生成pv][storageclass_pv]

[通过编写k8s的资源清单yaml文件部署gitlab服务][k8s_yaml_gitlab]

[helm安装和使用-通过helm部署k8s应用][helm_-_helm_k8s]

[Prometheus Operator-上篇-安装和使用篇][Prometheus Operator-_-]

[Prometheus Operator-下篇  
][Prometheus Operator-]

[通过kubeconfig登陆k8s的dashboard ui界面][kubeconfig_k8s_dashboard ui]

[通过token令牌登陆k8s dashboard ui界面][token_k8s dashboard ui]**          **

## 技术交流群    ##

学无止境，了解更多关于kubernetes/docker/devops/openstack/openshift/linux/IaaS/PaaS相关内容，想要获取更多资料和免费视频，可按如下方式进入技术交流群

**扫码加群????**

![format_png 3][]

**微信：**luckylucky421302

## 微信公众号    ##

**                                    ** **长按指纹关注公众号????**

![format_png 4][]

**                                       点击在看少个 bug????**

[Prometheus Operator-_-]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638626cc140f30c8d35e45239e6b559f7369b8c58bacd157a24e7b62313c826baec75f299f&idx=2&mid=2247485747&scene=21&sn=3da14a91d75f745b26c3aa8d10361d23#wechat_redirect
[Prometheus Operator-]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb63865bcc140f4d8966d1c3745c8f69c6384337c43a1a8eda6e1ae488bd78f08e44c9553b19&idx=1&mid=2247485774&scene=21&sn=1b0301dadc4b737e19b1066219813db7#wechat_redirect
[Prometheus_Grafana_Alertmanager_-]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638b08cc14021e5e025f2f0b89d18ec5ef19f9dec4429a56f356e8b596d01095e313dab3e3&idx=1&mid=2247484445&scene=21&sn=bf8928e7aae815b8e7f9ac56a67289ce#wechat_redirect
[Prometheus_Tomcat]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb63874ccc140e5a589bbff3ee05283d54f360d125ceef175b104a79ffc49aec60d652eddcbc&idx=1&mid=2247485529&scene=21&sn=54cff133740c3b68a585d83745a6929a#wechat_redirect
[Prometheus_Nginx]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638793cc140e85837cff551c268f897e091fbe976d6fbd89bdcd6558456683f4ee093eea0d&idx=1&mid=2247485574&scene=21&sn=32f1c9d0f900d9fe8e3110aa2818462a#wechat_redirect
[Prometheus_MySQL]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638780cc140e966e13a8b204b5ddcf87550e072eacd830c81811b2bd4ed79f131793940562&idx=1&mid=2247485589&scene=21&sn=e2e4d01791f0a0d2559708b88baadf4a#wechat_redirect
[Prometheus_Redis]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638605cc140f130564a9d41479af5b402e1e23e6cc1991b8dc63986bd37caa3138b7b9f445&idx=2&mid=2247485712&scene=21&sn=b1e471d035bdab80be7ab3e6f0bea748#wechat_redirect
[Alertmanager]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638ab7cc1403a1f6b07cbe682548595fe683f1ffdf56d2b4d31382003907a41da1e03c1408&idx=1&mid=2247484834&scene=21&sn=7f407f5a27b03b4757c8892f1b5d6234#wechat_redirect
[format_png]: /images/20230209/9efc8ad08ddc471eab12492e15c7a2a0.png
[format_png 1]: /images/20230209/3890f9f0a6464f8f92845d1ba3e3cafc.png
[format_png 2]: /images/20230209/d067954d896449a9ab0c0da99c4582e4.png
[kubernetes_k8s]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638a31cc14032772d778f1a8fa5dc73f9aba6c99546c9ab25d9f91f706be3cff34572f0c1a&idx=1&mid=2247484708&scene=21&sn=2a7230ade0ce0bd9059e92752e03ba18#wechat_redirect
[kubernetes]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638b9ccc14028a3220533e5e05f81b5b434cdc14f1cb4be6771a8afdb943f7f5f940704c61&idx=1&mid=2247484553&scene=21&sn=141700cdd2e13b87d5b756f8965a30c2#wechat_redirect
[DevOps]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638b81cc140297e292675f1e8ea21d3a9f05e01e488e642bcc1113d69d06d0afbd40446c0e&idx=1&mid=2247484564&scene=21&sn=3ec4b58056aec30acf82e84cfd9daa52#wechat_redirect
[kubernetes_-]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638b4acc14025c10c5b87f75ff8e95c89c97036f1f73250a64e2a829df191c95c34ed5b8b3&idx=1&mid=2247484511&scene=21&sn=7900c5a4eac3535be97315797d42d64b#wechat_redirect
[IT]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c29cc14053fafcb62be244f5a279052b8d159c9c530e73495cfd8ab97205988780d4aaa&idx=1&mid=2247484220&scene=21&sn=72ae437836108fbecbeb86752aad888c#wechat_redirect
[kubernetes_-k8s]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c42cc1405547ea583833c46878b6c120f5f39fb3746f89a8d2e515d432422b3019ded64&idx=1&mid=2247484247&scene=21&sn=c8986ed491e6c48cb6faab087fe8472c#wechat_redirect
[kubernetes_-kubectl]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638cbacc1405ac390b6c0fc7535e1cc805877a408c5f4a94a7148a47c186a57ff4f0c8ea32&idx=3&mid=2247484335&scene=21&sn=7e5ae586dae2016f6c0f5fcb60dd7317#wechat_redirect
[pod_pod_-_]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c30cc1405263cbd23e3fbe23f9ca9e83c1eb1800216a0e4e26e7c27d4234598def46bb1&idx=1&mid=2247484197&scene=21&sn=36ece95b266609bd769cf6a1fcf9d723#wechat_redirect
[Kubernetes_MySQL]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c73cc1405657ed02b3126423259cb8563c18d268fa7ffd4a516327cd35148ef61d8d762&idx=1&mid=2247484262&scene=21&sn=de970288426cdca05cf6ca0f5df4ff4c#wechat_redirect
[k8s1.18_master_-]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c7dcc14056b9f0261e05e4d36a057c4511fb5806222f71b7965c3573fed86672b2c93b7&idx=1&mid=2247484264&scene=21&sn=4d74de0cb117c07ba7c73ea21c42bf94#wechat_redirect
[k8s]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c36cc140520e6905db5923afe163d7babb5d9eb6c5e8045a795c37b33a2a2e5541e3efd&idx=1&mid=2247484195&scene=21&sn=b841f2ea305acfa2996a667d4ff4d99e#wechat_redirect
[-tomcat]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c21cc140537d10eeb8b4eb37e1451392123dd74513d704af00506c0576ba11da9907735&idx=1&mid=2247484212&scene=21&sn=923b044e9d2b4e5a612ac7c1307d166c#wechat_redirect
[linux]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638c5ecc14054862495a8f77d58d7483c34310839ea3ed93d8b44875a1685b3412d381f23a&idx=1&mid=2247484235&scene=21&sn=12e2e80187dbf217efff6c59da778f7c#wechat_redirect
[kubernetes_volume]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638ba8cc1402be9f8feca65582441f2d1b9ef6ceded048368ea6ad2a6eca3f8ae2f44a025f&idx=1&mid=2247484605&scene=21&sn=dfc6dd544423a766b4cd1b06fa59c8e1#wechat_redirect
[kubernetes_ceph rbd_cephfs]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638a07cc140311e6e111b9bb89e3613c495a26b6b496fe97c838787568c72dd1bb23088520&idx=1&mid=2247484690&scene=21&sn=32deb33cef9d91518cd8dea47da073c5#wechat_redirect
[jenkins_kubernetes_harbor_gitlab_devops]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638d2fcc14043990967471ba8a2aaf389ab483594fd81395b5afda1c23a9eff4371df6bca4&idx=1&mid=2247483962&scene=21&sn=595eac335f7fb523bbb60cbbede109ca#wechat_redirect
[kubernetes_-flannel]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c005de5f4913b3e81d32cf98dc4f237be04b0c19e02f615650538a9aa0aabdc025604918&idx=1&mid=2247483855&scene=21&sn=26587a359cca53d129ab7e8a7fa394e0#wechat_redirect
[kubernetes_-calico]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c073de5f49658fdaed40affb1a9ea3f059e7df3cc90ae24b194a8698a7f73089d3964cab&idx=1&mid=2247483833&scene=21&sn=c00c2b69db7d06eacaf6206805d2955a#wechat_redirect
[kubernetes 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c05fde5f494917570591168d9e71f507c2d124312c51dfdb6cfb30eb03eb48b73a3e0d9b&idx=1&mid=2247483797&scene=21&sn=bc208ee075c41b81ffabaefe509538ba#wechat_redirect
[k8s 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c0b4de5f49a2eef8cc91afa81095b71eb093e94dce6eddbc7059583e819b1ac51c596ebb&idx=1&mid=2247483774&scene=21&sn=dfc3babde045fe99da9fa168cc9f0595#wechat_redirect
[-]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c0bfde5f49a9990c672e4434f5ae7b74004dc1982cc44801c524b58067d9b245e5ba5b71&idx=1&mid=2247483765&scene=21&sn=b8444e82a93535425349b509ded4e4b6#wechat_redirect
[Prometheus_MySQL 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c0aade5f49bc7df29ecb2280ab9e1a8aa905b31e36856bf8dc19b05ef60c5e7be0333b88&idx=1&mid=2247483744&scene=21&sn=1035d73f8cf39caf8534766435497590#wechat_redirect
[Prometheus_Nginx 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c095de5f4983c249b1b556fa6f8f60a0bb6991d2872079a9d5c28ce2ee17b8fc407eeb2c&idx=1&mid=2247483743&scene=21&sn=3ad15cd693685479dc7bf5dd628796d2#wechat_redirect
[Prometheus_Tomcat 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c086de5f499011eb542c6da8ead32b538c0bf06340ebe56ad439e2649e0b63efbcb4a611&idx=1&mid=2247483724&scene=21&sn=dd390f05270c6ac7a9c2b51fdc22f0ee#wechat_redirect
[linux 1]: http://mp.weixin.qq.com/s?__biz=MzIzOTQ3NDg1Mw%3D%3D&chksm=e928c0dede5f49c878898e04329f08d8adf554397476283aaa3f2554f71a8bf20986755fbcc9&idx=1&mid=2247483668&scene=21&sn=a7d0768b7eb034ef2e2f23e25b1b1845#wechat_redirect
[storageclass_pv]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638837cc140121578456f6a5d679ae481421f2f3f1d5099bb7f2c56d00174fe61b2016061d&idx=1&mid=2247485218&scene=21&sn=ba698d444a029a2659091bfd81133697#wechat_redirect
[k8s_yaml_gitlab]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638814cc1401028c7ab321d2ac6579f5c6d2b029fadc5687874e41470bf95aa09c01c33d45&idx=1&mid=2247485185&scene=21&sn=2b5646119a008d69948c5a84d3724c95#wechat_redirect
[helm_-_helm_k8s]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638bbbcc1402ad16d4b65b3db26cbd324c85819934077caa41969f0c9d573b71b21e2c51ff&idx=1&mid=2247484590&scene=21&sn=2c23098269c5df1e793aa47198a7b1e6#wechat_redirect
[kubeconfig_k8s_dashboard ui]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638679cc140f6f4e024f2e7739b995fc235b6f4e97983a583bc9c7e82da88cf0fbf8736fe7&idx=1&mid=2247485804&scene=21&sn=c157f0596f130bd97ec745b278546c50#wechat_redirect
[token_k8s dashboard ui]: http://mp.weixin.qq.com/s?__biz=MzU0NjEwMTg4Mg%3D%3D&chksm=fb638687cc140f918f04ca60ed188da26cd3ab37a79e6fdbf64531efd11ae60dac0a77788f7c&idx=2&mid=2247485842&scene=21&sn=163174142218e8dca3bb9a94ed173694#wechat_redirect
[format_png 3]: /images/20230209/cc110415737843b58a102cc486913331.png
[format_png 4]: /images/20230209/82d35b01bd5643098f17625a86f8cf90.png