docker geovis_物理ceph集群+K8s

Myth丶恋晨 2022-12-31 11:25 114阅读 0赞

前提条件

在Ceph为k8s创建一个pool

ceph osd pool create k8s 128

创建admin用户

ceph auth get-or-create client.admin mon 'allow r' osd 'allow rwx pool=k8s'

将admin用户的key进行base64编码

\[root@node21 my-cluster\]\# ceph auth get-key client.admin | base64

QVFCbCtHTmQwdEN4TmhBQUdXcElhTkI1QXg0M2dDOWlNemM1dlE9PQ==

使用ceph的filesystem

在k8s集群中，创建secret

apiVersion: v1

kind: Secret

metadata:

data:

key: QVFCbCtHTmQwdEN4TmhBQUdXcElhTkI1QXg0M2dDOWlNemM1dlE9PQ==

注：secret是namespace资源，需要在使用的namespace下创建

创建对应的资源

apiVersion: apps/v1

kind: StatefulSet

metadata:

namespace: isphere-dev

spec:

replicas: 1

serviceName: demoapp-redis

selector:

matchLabels:

app: demoapp-redis

template:

metadata:

labels:

app: demoapp-redis

spec:

containers:

\- name: demoapp-redis

image: hub.geovis.io/dockerhub/redis

imagePullPolicy: Always

ports:

\- name: demoapp-redis

containerPort: 6379

volumeMounts:

\- name: demoapp-redis-path

mountPath: /var/lib/redis

volumes:

\- name: demoapp-redis-path

cephfs:

monitors:

\- 192.168.4.21:6789

\- 192.168.4.22:6789

\- 192.168.4.29:6789

user: admin

secretRef:

path: /k8svolume/isphere-dev/demoapp-redis

readOnly: false

k8s下使用ceph的动态扩展，storageclass

创建sceret

\[root@t31 ceph\_sc\]\# vi ceph-secret.yaml

apiVersion: v1

kind: Secret

metadata:

type: "kubernetes.io/rbd" \#重点

data:

key: QVFCbCtHTmQwdEN4TmhBQUdXcElhTkI1QXg0M2dDOWlNemM1dlE9PQ==

创建storageclass

\[root@t31 ceph\_sc\]\# vim storage-class-ceph.yaml

apiVersion: storage.k8s.io/v1

kind: StorageClass

metadata:

provisioner: kubernetes.io/rbd

parameters:

monitors: 192.168.4.21:6789,192.168.4.22:6789,192.168.4.29:6789

adminId: admin

adminSecretName: ceph-admin-secret

adminSecretNamespace: kube-system

pool: k8s

userId: admin

userSecretName: ceph-admin-secret

allowVolumeExpansion: true

reclaimPolicy: Delete

创建pvc

apiVersion: v1

kind: PersistentVolumeClaim

metadata:

spec:

accessModes:

\- ReadWriteOnce

storageClassName: ceph-rbd

resources:

requests:

storage: 10Gi

创建资源

apiVersion: v1

kind: Pod

metadata:

spec:

containers:

\- name: nginx

image: nginx:latest

volumeMounts:

\- name: nginx-test-vol1

mountPath: /data/

readOnly: false

volumes:

\- name: nginx-test-vol1

persistentVolumeClaim:

claimName: nginx-test-vol1-claim

docker geovis_物理ceph集群+K8s

发表评论取消回复

还没有评论，来说两句吧...

相关阅读

相关 K8S集群安装

相关 K8S集群部署

相关 docker geovis_物理ceph集群+K8s

相关 docker+jenkins+k8s集群搭建系列四、node节点安装k8s并加入集群

相关 docker+jenkins+k8s集群操作命令

相关 Docker+K8s集群搭建

相关 k8s集群部署

相关 k8s docker集群搭建

相关 k8s实践(3)--k8s集群安装详解

相关 Docker（十）--K8s管理docker集群