openstack-t swift搭建(完美搭建)2021

Bertha 。 2022-11-04 01:50 256阅读 0赞

### swift搭建 ###

*  前言
 *  基本配置
 *  安装开始
 *   *  创建身份服务凭据 controller
     *  安装和配置的部件 controller
     *  准备工作 object1(compute)
     *  安装和配置的部件 object1(compute)
     *  创建和分发初始环 controller
     *  完成安装 controller
     *  验证

# 前言 #

根据官方文档搭建，搭建结束后无法正常启动，然后无限摸索，最后成功安装。  
在计算节点上放置存储服务(我以下配置文件可以直接复制)

# 基本配置 #

controller :ens33(外网):192.168.100.100(nat)
    controller :ens34(内网):192.168.200.101(host-noly)
    compute :ens33(外网):192.168.100.101(nat)
    compute :ens34(内网):192.168.200.101(host-noly)

使用四张硬盘

# 安装开始 #

## 创建身份服务凭据 controller ##

创建swift用户:

openstack user create --domain default --password-prompt swift

![在这里插入图片描述][20210301152130468.png]  
admin向swift用户添加角色:

openstack role add --project service --user swift admin

该命令不提供任何输出  
创建swift服务实体：

openstack service create --name swift \
      --description "OpenStack Object Storage" object-store

![在这里插入图片描述][2021030115214363.png]  
创建对象存储服务API端点：

openstack endpoint create --region RegionOne \
    object-store public http://controller:8080/v1/AUTH_%\(project_id\)s
    
    openstack endpoint create --region RegionOne \
    object-store internal http://controller:8080/v1/AUTH_%\(project_id\)s
    
    openstack endpoint create --region RegionOne \
    object-store admin http://controller:8080/v1

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70]

## 安装和配置的部件 controller ##

yum install -y openstack-swift-proxy python-swiftclient \
      python-keystoneclient python-keystonemiddleware \
      Memcached

编辑/etc/swift/proxy-server.conf

echo -e "" >>/etc/swift/proxy-server.conf
    cat> /etc/swift/proxy-server.conf<<EOF [DEFAULT] bind_ip = 0.0.0.0 bind_port = 8080 user = swift [pipeline:main] pipeline = catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk ratelimit authtoken keystoneauth container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server [app:proxy-server] use = egg:swift#proxy allow_account_management = true account_autocreate = true #Keystone auth info [filter:authtoken] paste.filter_factory = keystonemiddleware.auth_token:filter_factory www_authenticate_uri = http://controller:5000 auth_url = http://controller:5000/v3 memcached_servers = controller:11211 auth_type = password project_domain_name = default user_domain_name = default project_name = service username = swift password = 000000 delay_auth_decision = true service_token_roles_required = True [filter:keystoneauth] use = egg:swift#keystoneauth operator_roles = admin,user [filter:healthcheck] use = egg:swift#healthcheck [filter:cache] use = egg:swift#memcache memcache_servers = controller:11211 [filter:ratelimit] use = egg:swift#ratelimit [filter:domain_remap] use = egg:swift#domain_remap [filter:catch_errors] use = egg:swift#catch_errors [filter:cname_lookup] use = egg:swift#cname_lookup [filter:staticweb] use = egg:swift#staticweb [filter:tempurl] use = egg:swift#tempurl [filter:formpost] use = egg:swift#formpost [filter:name_check] use = egg:swift#name_check [filter:list-endpoints] use = egg:swift#list_endpoints [filter:proxy-logging] use = egg:swift#proxy_logging [filter:bulk] use = egg:swift#bulk [filter:slo] use = egg:swift#slo [filter:dlo] use = egg:swift#dlo [filter:container-quotas] use = egg:swift#container_quotas [filter:account-quotas] use = egg:swift#account_quotas [filter:gatekeeper] use = egg:swift#gatekeeper [filter:container_sync] use = egg:swift#container_sync [filter:xprofile] use = egg:swift#xprofile [filter:versioned_writes] use = egg:swift#versioned_writes EOF

## 准备工作 object1(compute) ##

前提条件  
       在存储节点上安装和配置对象存储服务之前，必须准备存储设备  
这里我创建了1个node，挂载了4块device，因为object 最少需要4个device+3个replica。块硬盘。也可使用 2 硬盘 4分区方案  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 1]  
安装支持的实用程序包:

yum install xfsprogs rsync

将/dev/sdb和/dev/sdc设备格式化为XFS：

mkfs.xfs /dev/sdb
    mkfs.xfs /dev/sdc
    mkfs.xfs /dev/sdd
    mkfs.xfs /dev/sde

创建安装点目录结构：

mkdir -p /srv/node/sdb
    mkdir -p /srv/node/sdc
    mkdir -p /srv/node/sdd
    mkdir -p /srv/node/sde

编辑/etc/fstab文件并向其中添加以下内容

/dev/sdc /srv/node/sdb xfs noatime,nodiratime,nobarrier,logbufs=8 0 2
    /dev/sdd /srv/node/sdc xfs noatime,nodiratime,nobarrier,logbufs=8 0 2
    /dev/sdc /srv/node/sdd xfs noatime,nodiratime,nobarrier,logbufs=8 0 2
    /dev/sdd /srv/node/sde xfs noatime,nodiratime,nobarrier,logbufs=8 0 2

安装设备

mount /srv/node/sdb
    mount /srv/node/sdc
    mount /srv/node/sdd
    mount /srv/node/sde

创建或编辑/etc/rsyncd.conf文件以包含以下内容：

cat>/etc/rsyncd.conf<<EOF uid = swift gid = swift log file = /var/log/rsyncd.log pid file = /var/run/rsyncd.pid address = 192.168.200.101 [account] max connections = 2 path = /srv/node/ read only = False lock file = /var/lock/account.lock [container] max connections = 2 path = /srv/node/ read only = False lock file = /var/lock/container.lock [object] max connections = 2 path = /srv/node/ read only = False lock file = /var/lock/object.lock EOF

systemctl enable rsyncd.service
    systemctl start rsyncd.service

## 安装和配置的部件 object1(compute) ##

yum install -y openstack-swift-account openstack-swift-container \
      openstack-swift-object

编辑配置文件/etc/swift/account-server.conf

echo -e "" >>/etc/swift/account-server.conf
    cat> /etc/swift/account-server.conf<<EOF [DEFAULT] bind_ip = 192.168.200.101 bind_port = 6202 # keep_idle = 600 # bind_timeout = 30 # backlog = 4096 user = swift swift_dir = /etc/swift devices = /srv/node mount_check = true [pipeline:main] pipeline = healthcheck recon account-server [app:account-server] use = egg:swift#account [filter:healthcheck] use = egg:swift#healthcheck #An optional filesystem path, which if present, will cause the healthcheck #URL to return "503 Service Unavailable" with a body of "DISABLED BY FILE" #disable_path = [filter:recon] use = egg:swift#recon recon_cache_path = /var/cache/swift [account-replicator] [account-auditor] [account-reaper] [filter:xprofile] use = egg:swift#xprofile EOF

编辑/etc/swift/container-server.conf

echo -e " ">>/etc/swift/container-server.conf
    cat> /etc/swift/container-server.conf<<EOF [DEFAULT] bind_ip = 192.168.200.101 bind_port = 6201 # keep_idle = 600 # bind_timeout = 30 # backlog = 4096 user = swift swift_dir = /etc/swift devices = /srv/node mount_check = true [pipeline:main] pipeline = healthcheck recon container-server [app:container-server] use = egg:swift#container # [filter:healthcheck] use = egg:swift#healthcheck # An optional filesystem path, which if present, will cause the healthcheck # URL to return "503 Service Unavailable" with a body of "DISABLED BY FILE" # disable_path = [filter:recon] use = egg:swift#recon #recon_cache_path = /var/cache/swift [container-replicator] [container-updater] [container-auditor] [container-sync] [filter:xprofile] use = egg:swift#xprofile [container-sharder] EOF

编辑/etc/swift/object-server.conf

echo -e " ">>/etc/swift/object-server.conf 
    cat> /etc/swift/object-server.conf<<EOF
    [DEFAULT]
    bind_ip = 0.0.0.0
    bind_port = 6200
    # keep_idle = 600
    # bind_timeout = 30
    # backlog = 4096
    user = swift
    swift_dir = /etc/swift
    devices = /srv/node
    mount_check = true
    # ionice_priority =
    
    [pipeline:main]
    pipeline = healthcheck recon object-server
    
    [app:object-server]
    use = egg:swift#object
    recon_cache_path = /var/cache/swift
    recon_lock_path = /var/lock
    
    [filter:healthcheck]
    use = egg:swift#healthcheck
    # An optional filesystem path, which if present, will cause the healthcheck
    # URL to return "503 Service Unavailable" with a body of "DISABLED BY FILE"
    # disable_path =
    
    [filter:recon]
    use = egg:swift#recon
    #recon_cache_path = /var/cache/swift
    #recon_lock_path = /var/lock
    
    [object-replicator]
    
    [object-reconstructor]
    
    [object-updater]
    
    [object-expirer]
    [filter:xprofile]
    use = egg:swift#xprofile
    
    [object-relinker]
    
    [object-auditor]
    # You can override the default log routing for this app here (don't use set!):
    log_name = object-auditor
    log_facility = LOG_LOCAL0
    log_level = INFO
    log_address=/dev/log                                                                                              EOF

确保对安装点目录结构拥有适当的所有权：

chown -R swift:swift /srv/node

创建recon目录并确保对其拥有适当的所有权：

mkdir -p /var/cache/swift
     chown -R root:swift /var/cache/swift
     chmod -R 775 /var/cache/swift

在防火墙中启用必要的访问(实验忽略)

firewall-cmd --permanent --add-port=6200/tcp
    firewall-cmd --permanent --add-port=6201/tcp
    firewall-cmd --permanent --add-port=6202/tcp

## 创建和分发初始环 controller ##

转到/etc/swift目录。(所以操作在此目录，执行)  
创建用户环account.builder文件：

swift-ring-builder account.builder create 10 3 1

该命令不提供任何输出  
将每个存储节点添加到环中

swift-ring-builder account.builder add \
       --region 1 --zone 1 --ip 192.168.200.101 --port 6202 --device sdb --weight 100
    
    swift-ring-builder account.builder add \
       --region 1 --zone 1 --ip 192.168.200.101 --port 6202 --device sdc --weight 100
    swift-ring-builder account.builder add \
       --region 1 --zone 2 --ip 192.168.200.101 --port 6202 --device sdd --weight 100
    
    swift-ring-builder account.builder add \
       --region 1 --zone 2 --ip 192.168.200.101 --port 6202 --device sde --weight 100

这里必须为存储节点IP地址  
验证

swift-ring-builder account.builder

![在这里插入图片描述][20210301153126186.png]  
重新平衡环且验证

swift-ring-builder account.builder rebalance
    swift-ring-builder account.builder

![在这里插入图片描述][2021030115314126.png]  
创建容器环

swift-ring-builder container.builder create 10 3 1

将每个存储节点添加到环中

swift-ring-builder container.builder add \
      --region 1 --zone 1 --ip 192.168.200.101 --port 6201 --device sdb --weight 100
    swift-ring-builder container.builder add \
      --region 1 --zone 1 --ip 192.168.200.101 --port 6201 --device sdc --weight 100
    swift-ring-builder container.builder add \
      --region 1 --zone 2 --ip 192.168.200.101 --port 6201 --device sdd --weight 100
    swift-ring-builder container.builder add \
      --region 1 --zone 2 --ip 192.168.200.101 --port 6201 --device sde --weight 100

验证

swift-ring-builder container.builder

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 2]  
重新平衡

swift-ring-builder container.builder rebalance

![在这里插入图片描述][20210301153203695.png]  
创建对象环

swift-ring-builder object.builder create 10 3 1
    swift-ring-builder object.builder add \
      --region 1 --zone 1 --ip 192.168.200.101 --port 6200 --device sdb --weight 100
    swift-ring-builder object.builder add \
      --region 1 --zone 1 --ip 192.168.200.101 --port 6200 --device sdc --weight 100
    swift-ring-builder object.builder add \
      --region 1 --zone 2 --ip 192.168.200.101 --port 6200 --device sdd --weight 100
    swift-ring-builder object.builder add \
      --region 1 --zone 2 --ip 192.168.200.101 --port 6200 --device sde --weight 100
    验证
    swift-ring-builder object.builder

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 3]  
重新平衡

swift-ring-builder object.builder rebalance

分发  
将swift目录下生成三个.gz文件复制到存储节点的swift目录下

scp account.ring.gz container.ring.gz object.ring.gz 192.168.200.101:/etc/swift

## 完成安装 controller ##

创建配置文件/etc/swift/swift.conf

echo -e “ ” >> /etc/swift/swift.conf
    cat> /etc/swift/swift.conf<<EOF [swift-hash] swift_hash_path_suffix = swift swift_hash_path_prefix = swift [storage-policy:0] name = Policy-0 default = yes EOF

复制到存储节点上

scp swift.conf 192.168.200.101:/etc/swift

swift_hash_path_suffix和swift_hash_path_prefix作为哈希算法的一部分用于确定数据在集群中的位置。
    这些值应该保持机密，并且在部署集群之后不能更改丢失。可自定义
    在所有节点确保对配置目录拥有适当的所有权：
    chown -R root:swift /etc/swift 存储节点与控制节点同时执行
    在控制器节点和任何其他运行代理服务的节点上，启动对象存储代理服务及其相关性，并将它们配置为在系统启动时启动(存储节点无代理服务)

systemctl enable openstack-swift-proxy.service memcached.service
     systemctl start openstack-swift-proxy.service memcached.service

在存储节点启动所有服务

systemctl enable openstack-swift-account.service openstack-swift-account-auditor.service \
      openstack-swift-account-reaper.service openstack-swift-account-replicator.service
     systemctl start openstack-swift-account.service openstack-swift-account-auditor.service \
      openstack-swift-account-reaper.service openstack-swift-account-replicator.service
     systemctl enable openstack-swift-container.service \
      openstack-swift-container-auditor.service openstack-swift-container-replicator.service \
      openstack-swift-container-updater.service
     systemctl start openstack-swift-container.service \
      openstack-swift-container-auditor.service openstack-swift-container-replicator.service \
      openstack-swift-container-updater.service
     systemctl enable openstack-swift-object.service openstack-swift-object-auditor.service \
      openstack-swift-object-replicator.service openstack-swift-object-updater.service
     systemctl start openstack-swift-object.service openstack-swift-object-auditor.service \
      openstack-swift-object-replicator.service openstack-swift-object-updater.service

## 验证 ##

查看服务状态  
`swift stat` ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 4]

上传文件创建容器

swift upload demo cirros-0.5.1-x86_64-disk.img --object-name image

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 5]

[20210301152130468.png]: /images/20221023/ea83663889b94564a3a744a504f75014.png
[2021030115214363.png]: /images/20221023/5575dcc97aa9443a9c98907fd5ad87a6.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70]: /images/20221023/7cd01eb8fec4431b862a3d8b5dd8e814.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 1]: /images/20221023/6c0d765d03084728b23bb703ef3b93d5.png
[20210301153126186.png]: /images/20221023/27d406063d504485bfc0565af0f6a51e.png
[2021030115314126.png]: /images/20221023/c3170e621fc14fbfb17401381078cd44.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 2]: /images/20221023/f84bdee552a24ac88296e457ebf5b8bc.png
[20210301153203695.png]: /images/20221023/804be1c2a2104de1b7baa709e68c7b2e.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 3]: /images/20221023/885a054f2e634fbd8716e8a4aeb2e46a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 4]: /images/20221023/65226bef907c4bc189fe50dab3da8307.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2tpbmdvZmxvbmdldml0eQ_size_16_color_FFFFFF_t_70 5]: /images/20221023/3eff4f0390f740f38d60cf1e983d2fe4.png