基于Kubernetes的框架和应用系列之二：在Kubernetes部署NFS作为Persistent Volume

痛定思痛。 2022-10-01 13:48 209阅读 0赞

### 一、前言 ###

[Kubernetes支持NFS][Kubernetes_NFS]作为外部永久存储分配给容器使用，这种简易方式适用于小范围低强度的文件共享和持久化。

为了使得NFS能够和Kubernetes进行云原生的结合，需要一个nfs-provisioner来进行粘合，比如[nfs-client-provisioner][]。

转载自https://blog.csdn.net/cloudvtech

### 二、安装NFS服务器 ###

**2.1 安装软件 **

mkdir /home/nfs
    cd /home/nfs/
    yum install nfs-utils
    systemctl enable rpcbind
    systemctl enable nfs
    systemctl start rpcbind
    systemctl start nfs
    firewall-cmd --zone=public --permanent --add-service=rpc-bind
    firewall-cmd --zone=public --permanent --add-service=mountd
    firewall-cmd --zone=public --permanent --add-service=nfs
    firewall-cmd --reload
    chmod 755  /home/nfs/

**2.2 配置 /etc/exports**

/home/nfs *(insecure,rw,sync,no_root_squash,no_all_squash)
    
    systemctl restart nfs
    
    showmount -e localhost
    Export list for localhost:
    /home/nfs *

**2.3 在客户端测试**

yum install nfs-utils
     systemctl enable rpcbind
     systemctl start rpcbind
     showmount -e 172.2.2.13
     mkdir /mnt/nfs
     mount -t nfs 172.2.2.13:/home/nfs /mnt/nfs/
     mount
     touch /mnt/nfs/test
     ls /mnt/nfs/test  -l

转载自https://blog.csdn.net/cloudvtech

### 三、安装nfs-client-provisioner ###

通过helm安装

helm install stable/nfs-client-provisioner --set nfs.server=172.2.2.13 --set nfs.path=/home/nfs 
    NAME:   quiet-toucan
    LAST DEPLOYED: Wed Oct 10 09:21:19 2018
    NAMESPACE: default
    STATUS: DEPLOYED
    RESOURCES:
    ==> v1/StorageClass
    NAME        PROVISIONER                                        AGE
    nfs-client  cluster.local/quiet-toucan-nfs-client-provisioner  31s
    ==> v1/ServiceAccount
    NAME                                 SECRETS  AGE
    quiet-toucan-nfs-client-provisioner  1        31s
    ==> v1/ClusterRole
    NAME                                        AGE
    quiet-toucan-nfs-client-provisioner-runner  31s
    ==> v1/ClusterRoleBinding
    NAME                                     AGE
    run-quiet-toucan-nfs-client-provisioner  31s
    ==> v1/Role
    NAME                                                AGE
    leader-locking-quiet-toucan-nfs-client-provisioner  31s
    ==> v1/RoleBinding
    NAME                                                AGE
    leader-locking-quiet-toucan-nfs-client-provisioner  31s
    ==> v1/Deployment
    NAME                                 DESIRED  CURRENT  UP-TO-DATE  AVAILABLE  AGE
    quiet-toucan-nfs-client-provisioner  1        1        1           0          31s
    ==> v1/Pod(related)
    NAME                                                 READY  STATUS             RESTARTS  AGE
    quiet-toucan-nfs-client-provisioner-88d4c9564-vccgr  0/1    ContainerCreating  0         31s

确认POD和StorageClass

[root@k8s-master-01 nfs-client]# kubectl get pod | grep nfs
    quiet-toucan-nfs-client-provisioner-88d4c9564-vccgr   1/1       Running     0          18m
    
    [root@k8s-master-01 nfs-client]# kubectl get sc
    NAME                  PROVISIONER                                         AGE
    nfs-client            cluster.local/quiet-toucan-nfs-client-provisioner   18m

转载自https://blog.csdn.net/cloudvtech

### 四、使用StorageClass based NFS ###

PVC文件：test-claim.yaml

kind: PersistentVolumeClaim
    apiVersion: v1
    metadata:
      name: test-claim
      annotations:
        volume.beta.kubernetes.io/storage-class: "nfs-client"
    spec:
      accessModes:
        - ReadWriteMany
      resources:
        requests:
          storage: 1Mi

使用PVC：test-pod.yaml

kind: Pod
    apiVersion: v1
    metadata:
      name: test-pod
    spec:
      containers:
      - name: test-pod
        image: gcr.io/google_containers/busybox:1.24
        command:
          - "/bin/sh"
        args:
          - "-c"
          - "touch /mnt/SUCCESS && exit 0 || exit 1"
        volumeMounts:
          - name: nfs-pvc
            mountPath: "/mnt"
      restartPolicy: "Never"
      volumes:
        - name: nfs-pvc
          persistentVolumeClaim:
            claimName: test-claim

创建PVC和POD

> kubectl create -f deploy/test-claim.yaml -f deploy/test-pod.yaml

查看在NFS共享目录下由Kubernetes自动创建的PVC目录

ls /home/nfs//default-test-claim-pvc-879d441b-cc70-11e8-9135-fa163ebda1b8/
    SUCCESS

kubectl describe pv pvc-879d441b-cc70-11e8-9135-fa163ebda1b8
    Name:            pvc-879d441b-cc70-11e8-9135-fa163ebda1b8
    Labels:          <none>
    Annotations:     pv.kubernetes.io/provisioned-by=cluster.local/quiet-toucan-nfs-client-provisioner
    Finalizers:      [kubernetes.io/pv-protection]
    StorageClass:    nfs-client
    Status:          Bound
    Claim:           default/test-claim
    Reclaim Policy:  Delete
    Access Modes:    RWX
    Capacity:        1Mi
    Node Affinity:   <none>
    Message:         
    Source:
        Type:      NFS (an NFS mount that lasts the lifetime of a pod)
        Server:    172.2.2.13
        Path:      /home/nfs/default-test-claim-pvc-879d441b-cc70-11e8-9135-fa163ebda1b8
        ReadOnly:  false
    Events:        <none>

kubectl describe pvc test-claim
    Name:          test-claim
    Namespace:     default
    StorageClass:  nfs-client
    Status:        Bound
    Volume:        pvc-879d441b-cc70-11e8-9135-fa163ebda1b8
    Labels:        <none>
    Annotations:   pv.kubernetes.io/bind-completed=yes
                   pv.kubernetes.io/bound-by-controller=yes
                   volume.beta.kubernetes.io/storage-class=nfs-client
                   volume.beta.kubernetes.io/storage-provisioner=cluster.local/quiet-toucan-nfs-client-provisioner
    Finalizers:    [kubernetes.io/pvc-protection]
    Capacity:      1Mi
    Access Modes:  RWX
    Events:
      Type    Reason                 Age              From                                                                                                                                        Message
      ----    ------                 ----             ----                                                                                                                                        -------
      Normal  Provisioning           7m               cluster.local/quiet-toucan-nfs-client-provisioner_quiet-toucan-nfs-client-provisioner-88d4c9564-vccgr_52eca4e7-cc6d-11e8-a267-8a77c6fda26c  External provisioner is provisioning volume for claim "default/test-claim"
      Normal  ProvisioningSucceeded  7m               cluster.local/quiet-toucan-nfs-client-provisioner_quiet-toucan-nfs-client-provisioner-88d4c9564-vccgr_52eca4e7-cc6d-11e8-a267-8a77c6fda26c  Successfully provisioned volume pvc-879d441b-cc70-11e8-9135-fa163ebda1b8
      Normal  ExternalProvisioning   4m (x3 over 4m)  persistentvolume-controller                                                                                                                 waiting for a volume to be created, either by external provisioner "cluster.local/quiet-toucan-nfs-client-provisioner" or manually created by system administrator

在POD内查看

> kubectl exec -it test-pod sh
> 
> / \# mount | grep nfs
> 
> 172.2.2.13:/home/nfs/default-test-claim-pvc-27b0d062-8cda-11e9-b430-fa163ebda1b8 on /mnt type nfs4 (rw,relatime,vers=4.1,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=172.2.2.11,local\_lock=none,addr=172.2.2.13)
> 
> / \# ls -l /mnt/
> 
> total 0
> 
> \-rw-r--r--    1 root     root             0 Jun 12 06:21 SUCCESS

转载自https://blog.csdn.net/cloudvtech

[Kubernetes_NFS]: https://kubernetes.io/docs/concepts/storage/volumes/#nfs
[nfs-client-provisioner]: https://github.com/kubernetes-incubator/external-storage.git