【ironic】ironic 部署

傷城~ 2022-06-13 08:37 168阅读 0赞

**零。介绍**

集成keystone, nova, neutron, glance, swift等服务。

为什么使用bare metal?

高性能计算集群。

**一。配置keystone**

IRONIC\_NODE\_IP=$ip

openstack user create ironic --password password --domain default

openstack role add admin --user ironic --project service

openstack service create baremetal --name ironic --description "Ironic baremetal provisioning service"

openstack endpoint create baremetal admin http://$IRONIC\_NODE\_IP:6385 --region RegionOne

openstack endpoint create baremetal internal http://$IRONIC\_NODE\_IP:6385 --region RegionOne

openstack endpoint create baremetal public http://$IRONIC\_NODE\_IP:6385 --region RegionOne

--------------------

**二。配置DB**

\# mysql -u root -p

mysql> CREATE DATABASE ironic CHARACTER SET utf8;

mysql> GRANT ALL PRIVILEGES ON ironic.\* TO 'ironic'@'localhost' \\IDENTIFIED BY 'IRONIC\_DBPASSWORD';

mysql> GRANT ALL PRIVILEGES ON ironic.\* TO 'ironic'@'%' \\IDENTIFIED BY 'IRONIC\_DBPASSWORD';

\# 必须指定 --config-file, 创建数据库表

ironic-dbsync --config-file /etc/ironic/ironic.conf create\_schema

--------------------

**三。配置flavor**

RAM\_MB=102400

CPU=32

DISK\_GB=100

ARCH=x86\_64

baremetal\_flavor=baremetal-flavor

nova flavor-create $\{baremetal\_flavor\} auto $RAM\_MB $DISK\_GB $CPU

\# add spec for all nova flavor

nova flavor-key $\{vm\_flavor\} set capabilities:hypervisor\_type=QEMU

nova flavor-show $\{vm\_flavor\}

\# add spec for all baremetal flavor

nova flavor-key $\{baremetal\_flavor\} set capabilities:hypervisor\_type=ironic

nova flavor-show $\{baremetal\_flavor\}

--------------------

**四。准备部署镜像**

glance image-create --name ironic-deploy.kernel --visibility public --disk-format aki --container-format aki < ironic-deploy.vmlinuz

glance image-create --name ironic-deploy.ramdisk --visibility public --disk-format ari --container-format ari < ironic-deploy.initramfs

\# 用户镜像

disk-image-create centos7 vm dhcp-all-interfaces -o ironic-centos7-wdiglance image-create --name ironic-centos7-wdi --visibility public --disk-format qcow2 --container-format bare < ironic-centos7-wdi.qcow2

--------------------

**五。部署ironic**

\# 安装

yum install openstack-ironic-api openstack-ironic-conductor python-ironicclient

systemctl enable openstack-ironic-api openstack-ironic-conductor

systemctl start openstack-ironic-api openstack-ironic-conductor

\# 配置\[root@baremetal-128-234 yuankui\]\# cat /etc/ironic/ironic.conf

\[DEFAULT\]

enabled\_network\_interfaces=noop,flat,neutron

d efault\_network\_interface=neutron

auth\_strategy=keystone

enabled\_drivers=pxe\_ipmitool

my\_ip=$my\_ip

debug=True

\[agent\]

deploy\_logs\_collect=always

\[amt\]

\[api\]

\[cimc\]

\[cisco\_ucs\]

\[conductor\]

api\_url=http://$my\_ip:6385

clean\_callback\_timeout=0 \#生产环境要配置超时时间，建议>>600

\[console\]

\[cors\]

\[cors.subdomain\]\[database\]

connection=mysql+pymysql://ironic:$ironic\_password@@mysqlserver:3308/ironic

max\_pool\_size=5

max\_overflow=15

connection\_trace=true

use\_db\_reconnect=true

\[deploy\]

shred\_random\_overwrite\_iterations=0

shred\_final\_overwrite\_with\_zeros=False

\[dhcp\]

dhcp\_provider=neutron

\[disk\_partitioner\]

\[disk\_utils\]

\[glance\]

glance\_api\_servers=http://keystone.\_ip:9292

auth\_strategy=keystone

\[iboot\]

\[ilo\]

\[inspector\]

\[ipmi\]

retry\_timeout=600

\[irmc\]

\[ironic\_lib\]

\[keystone\]

region\_name=RegionOne

\[keystone\_authtoken\]

auth\_uri=http://keystone\_ip:35357/v2.0

admin\_user=ironic

admin\_password=password

admin\_tenant\_name=service

identity\_uri=http://keystone\_ip:35357

auth\_version=v2.0

region\_name=RegionOne

\[matchmaker\_redis\]

\[neutron\]

url=http://baremetal-128-234.com:9696

auth\_strategy=keystone

cleaning\_network\_uuid=d2a32993-48b4-4a02-95ea-0756b865a13f

provisioning\_network\_uuid=d2a32993-48b4-4a02-95ea-0756b865a13f

\[oneview\]

\[oslo\_concurrency\]

\[oslo\_messaging\_amqp\]

\[oslo\_messaging\_notifications\]

\[oslo\_messaging\_rabbit\]

rabbit\_hosts=rabbitmq-a:5672, rabbitmq-b:5672

rabbit\_userid=rabbitmq

rabbit\_password=rabbitmq\_password

rabbit\_ha\_queues=true

heartbeat\_timeout\_threshold=0

\[oslo\_policy\]

\[pxe\]

pxe\_append\_params=nofb nomodeset vga=normal console=tty0 console=ttyS0,115200n8

tftp\_server=tftp\_server

tftp\_root=/tftpboot

tftp\_master\_path=/tftpboot/master\_images

images\_path=/ironic/images

instance\_master\_path=/ironic/master\_images

\[seamicro\]

\[snmp\]

\[ssh\]

\[ssl\]

\[swift\]

\[virtualbox\]

\# 初始化DB

ironic-dbsync --config-file /etc/ironic/ironic.conf

create\_schema

\# 重启服务

sudo systemctl restart openstack-ironic-api

sudo systemctl restart openstack-ironic-conductor

--------------------

**六。部署TFTP**

\# 安装xinetd

yum -y install xinetd

\# 安装tftp

sudo mkdir -p /tftpboot

sudo chown -R ironic /tftpbootsudo

yum install tftp-server syslinux-tftpboot

\# 配置tftp map file

echo 're ^(/tftpboot/) /tftpboot/\\2' > /tftpboot/map-file

echo 're ^/tftpboot/ /tftpboot/' >> /tftpboot/map-file

echo 're ^(^/) /tftpboot/\\1' >> /tftpboot/map-file

echo 're ^(\[^/\]) /tftpboot/\\1' >> /tftpboot/map-file

\# 配置/etc/xinetd.d/tftp

server\_args = -v -v -v -v -v --map-file /tftpboot/map-file /tftpboot

\# 准备pxelinux.0

cp /var/lib/tftpboot/pxelinux.0 /tftpboot/

cp /var/lib/tftpboot/chain.c32 /tftpboot/

\# 重启tftp服务

systemctl restart xinetd

ps aux|grep tftp

\# 验证服务可用

echo 'test tftp' > /tftpboot/aaa \#先在tftp server root dir下创建一个测试文件aaa

tftp $host -c get aaa \#用tftp client从server端拉取指定文件aaa

cat aaa \#确认拉取成功

--------------------

**七。配置nova（主要是ironic nova compute）**

/etc/nova/nova.conf

\# 安装

yum install openstack-nova-compute openstack-nova-common python-novaclient

\# 配置

\[DEFAULT\]

compute\_driver=ironic.IronicDriver

firewall\_driver=nova.virt.firewall.NoopFirewallDriver

update\_resources\_interval=10

reserved\_host\_memory\_mb=0

reserved\_host\_disk\_mb=0

cpu\_allocation\_ratio=1.0

ram\_allocation\_ratio=1.0

disk\_allocation\_ratio=1.0

bandwidth\_poll\_interval=-1

\[ironic\]

api\_endpoint=http://baremetal-128-234.com:6385

admin\_url=http://keystone.com:5000

admin\_username=ironic

admin\_password=password

admin\_tenant\_name=service

\[neutron\]

url = http://baremetal-128-234.com:9696

\# 重启服务

sudo service nova-compute restart

--------------------

**八。准备eth5及br-eth5网卡**

重启网络服务，将自动建立 br-eth4

cat /etc/sysconfig/network-scripts/ifcfg-eth4

DEVICE=eth4

TYPE=OVSPort

DEVICETYPE=ovs

OVS\_BRIDGE=br-eth4

ONBOOT=yes

cat /etc/sysconfig/network-scripts/ifcfg-br-eth4

DEVICE=br-eth4

DEVICETYPE=ovs

TYPE=OVS Bridge

BOOTPROTO=static

IPADDR=10.10.10.10

NETMASK=255.255.255.0

GATEWAY=10.10.10.1

ONBOOT=yes

--------------------

**九。部署ironic节点上neutron dhcp agent**

重启ovsagent，将自动建立br-int,及相应的patch interface

\# 安装neutron相关组件

yum install networking-plato openstack-neutron-openvswitch openstack-neutron-common openstack-neutron-rpc-server openstack-neutron python-neutron-lib python-neutronclient python-neutron

\# 配置ml2 pulgin配置

vim /etc/neutron/plugin.ini

\[ml2\]

\# type\_drivers = flat \# for flat

\# tenant\_network\_types = flat \# for flat

\# mechanism\_drivers = openvswitch  \# for flat

type\_drivers = flat,vxlan \# for multi-tenant

tenant\_network\_types = flat,vxlan \# for multi-tenant

mechanism\_drivers = networking-plugin \# for multi-tenant

\[ml2\_type\_flat\]

flat\_networks = physnet1

\[ml2\_type\_vlan\]

network\_vlan\_ranges = physnet1

\[securitygroup\]

firewall\_driver = neutron.agent.linux.iptables\_firewall.OVSHybridIptablesFirewallDriver

enable\_security\_group = True

\[ovs\]

bridge\_mappings = physnet1:br-eth4

\# \# 配置ml2 pulgin ovs agent配置

\# cat /etc/neutron/plugins/ml2/openvswitch\_agent.ini

\# \[ovs\]

\# bridge\_mappings = physnet1:br-eth4

\# 准备虚拟网桥

ovs-vsctl add-br br-int

ovs-vsctl add-br br-eth4

ovs-vsctl add-port br-eth4 eth4

\# 重启neutron ovs agent，使配置生效

service neutron-plugin-openvswitch-agent restart

service neutron-server restart

--------------------

**十。创建neutron cleaning network**

dhcp-agent-uuid=d2a32993-48b4-4a02-95ea-0756b865a13f

n eutron net-create cleaning\_network --provider:network\_type flat --provider:physical\_network physnet1 --shared

neutron subnet-create cleaning\_network 10.248.128.0/24 --name cleaning\_subnet --ip-version=4 --gateway=10.248.128.1 --allocation-pool start=10.248.128.181,end=10.248.128.199 --enable-dhcp \# cleaning net需要开启 dhcp

neutron dhcp-agent-network-add $dhcp-agent-uuid $cleaning\_network \#让指定的dhcp agent管理指定的network

neutron net-list-on-dhcp-agent $dhcp-agent-uuid

--------------------

**十一。添加baremetal node**

IRONIC\_API\_VERSION=1.20

cleaning\_network=11111

deploy\_kernel=222222

deploy\_ramdisk=3333331

image\_source=44444444

baremetal\_flavor=baremetal-flavor

baremetal\_name=baremetal\_103

tenant\_network=5555555

ironic\_node\_uuid=00000000-0000-0000-0000-000000000250

ironic\_port\_addr='fc:b9:01:9c:86:a0'

ipmi\_address=10.10.100.10

ipmi\_port=623

ipmi\_username=ipmi\_user

pmi\_password=ipmi\_password

switch\_id='00:00:00:00:00:00'

switch\_ip='10.200.200.200'

switch\_port\_id='xe-0/0/4'

echo "prepare ironic node"

ironic node-create -d pxe\_ipmitool -u $\{ironic\_node\_uuid\}ironic

node-update $\{ironic\_node\_uuid\} add driver\_info/ipmi\_address=$\{ipmi\_address\}

ironic node-update $\{ironic\_node\_uuid\} add driver\_info/ipmi\_port=$\{ipmi\_port\}ironic

node-update $\{ironic\_node\_uuid\} add driver\_info/ipmi\_username=$\{ipmi\_username\}

ironic node-update $\{ironic\_node\_uuid\} add driver\_info/ipmi\_password=$\{ipmi\_password\}

ironic node-update $\{ironic\_node\_uuid\} add driver\_info/deploy\_kernel=$\{deploy\_kernel\}

ironic node-update $\{ironic\_node\_uuid\} add driver\_info/deploy\_ramdisk=$\{deploy\_ramdisk\}

ironic node-update $\{ironic\_node\_uuid\} add properties/cpus=32ironic

node-update $\{ironic\_node\_uuid\} add properties/memory\_mb=204800ironic

node-update $\{ironic\_node\_uuid\} add properties/local\_gb=1000ironic

node-update $\{ironic\_node\_uuid\} add properties/cpu\_arch=x86\_64

ironic node-update $\{ironic\_node\_uuid\} add instance\_info/root\_gb=1000

ironic node-update $\{ironic\_node\_uuid\} add instance\_info/capabilities='\{"boot\_option":"local"\}'

echo "prepare ironic node's port"

ironic port-create -n $\{ironic\_node\_uuid\} -a $\{ironic\_port\_addr\} -l switch\_id=$\{switch\_id\} -l switch\_info=$\{switch\_ip\} -l port\_id=$\{switch\_port\_id\}

ironic node-validate $\{ironic\_node\_uuid\}

**00 Troubleshooting Ironic**

**1. No valid host was found**

确保有足够的节点是available状态的，不能是maintenance模式，也不是被存在的实例实用的，可以使用命令如下检查：

ironic node-list --provision-state available --maintenance false --associated false

node是manageable状态的应该变成available的

ironic node-set-provision-state $uuid provide

ironic node-set-maintenance $uuid off

**2. 属性JSON有合法的值**

$ ironic node-show $uuid --fields properties

\+------------+-----------------------------------------------------------------------+  
| Property   | Value                                                                 |  
\+------------+-----------------------------------------------------------------------+  
| properties | \{u'memory\_mb': 1024000, u'cpu\_arch': u'x86\_64', u'local\_gb': 1024000, |  
|            | u'cpus': 1000, u'capabilities': u'type:comm2'\}                        |  
\+------------+-----------------------------------------------------------------------+

**3. nova flavor匹配ironic节点**

openstack flavor show <FLAVOR\_NAME>

查看flavor属性

$ openstack flavor show stp-calc2-c24m102400d100r1 -c properties  
\+------------+------------------------------------------------------------------+  
| Field      | Value                                                            |  
\+------------+------------------------------------------------------------------+  
| properties | capabilities:hypervisor\_type='ironic', capabilities:type='calc2' |  
\+------------+------------------------------------------------------------------+

查看ironic node节点属性

\# ironic node-show 00000000-0000-0000-0000-010003024220 --fields properties  
\+------------+-----------------------------------------------------------------------+  
| Property   | Value                                                                 |  
\+------------+-----------------------------------------------------------------------+  
| properties | \{u'memory\_mb': 1024000, u'cpu\_arch': u'x86\_64', u'local\_gb': 1024000, |  
|            | u'cpus': 1000, u'capabilities': u'type:comm2'\}                        |  
\+------------+-----------------------------------------------------------------------+