（菜汪学docker）用vmware 完成 docker+ovs+vxlan 实现容器跨主机访问

清疚 2022-06-09 01:48 276阅读 0赞

本汪刚开始学习ovs,觉得这不是一天两天就能学会的东西，所以就不谈感想和总结了，分享一下我的学习链接吧,自己耐心感悟吧。

<table style=""> 
 <tbody> 
 <tr> 
 <td style="background-color:rgb(250,226,32)">学习链接</td> 
 <td style="background-color:rgb(250,226,32)"> </td> 
 </tr> 
 <tr> 
 <td>ovs</td> 
 <td style="color:rgb(0,56,132)"><a href="http://blog.csdn.net/tantexian/article/details/46707175" rel="nofollow">http://blog.csdn.net/tantexian/article/details/46707175</a></td> 
 </tr> 
 <tr> 
 <td>ovs</td> 
 <td style="color:rgb(0,56,132)"><a href="http://www.cnblogs.com/popsuper1982/p/5848879.html" rel="nofollow">http://www.cnblogs.com/popsuper1982/p/5848879.html</a></td> 
 </tr> 
 <tr> 
 <td>openflow</td> 
 <td style="color:rgb(0,56,132)"><a href="http://blog.csdn.net/wangpengqi/article/details/17400947" rel="nofollow">http://blog.csdn.net/wangpengqi/article/details/17400947</a></td> 
 </tr> 
 <tr> 
 <td>ovs</td> 
 <td style="color:rgb(0,56,132)"><a href="http://vinllen.com/ovs-datapathbi-ji/" rel="nofollow">http://vinllen.com/ovs-datapathbi-ji/</a></td> 
 </tr> 
 <tr> 
 <td>ovs 实验</td> 
 <td style="color:rgb(0,56,132)"><a href="http://www.sdnlab.com/8236.html" rel="nofollow">http://www.sdnlab.com/8236.html</a></td> 
 </tr> 
 <tr> 
 <td>docker 网络</td> 
 <td style="color:rgb(0,56,132)"><a href="http://www.infoq.com/cn/articles/docker-network-and-pipework-open-source-explanation-practice" rel="nofollow">http://www.infoq.com/cn/articles/docker-network-and-pipework-open-source-explanation-practice</a></td> 
 </tr> 
 <tr> 
 <td>docker</td> 
 <td style="color:rgb(0,56,132)"><a href="http://www.cnblogs.com/sammyliu/p/5878973.html" rel="nofollow">http://www.cnblogs.com/sammyliu/p/5878973.html</a></td> 
 </tr> 
 </tbody> 
</table>

开始vmware试验，这里虚拟机我觉的必须双网卡才能完成这个试验，可能由于是vmware虚拟机的原因吧。![害羞][shy.gif]

先上一张比较low的图

![Center][]

配置虚拟机ABC的网络 A:192.168.0.11 B(两块网卡):192.168.0.16 192.168.0.18（eno33554992） C（两块网卡）:192.168.0.17 192.168.0.19（eno33554992）

虚拟机A要能访问到B C

修改三台机器的系统参数 fs.aio-max-nr = 65536 net.bridge.bridge-nf-call-iptables = 1 net.bridge.bridge-nf-call-iptables = 1 net.bridge.bridge-nf-call-ip6tables = 1

网关配置 虚拟机BC的网关配置为虚拟机A的IP 安装docker 这个百度吧 大把大把的文章

安装ovs

<table style=""> 
 <tbody> 
 <tr> 
 <td> </td> 
 <td>modprobe &nbsp;openvswitch</td> 
 </tr> 
 <tr> 
 <td># ovs的核心模块，配合ovs-vswitchd使用</td> 
 <td>insmod datapath/openvswitch.ko</td> 
 </tr> 
 <tr> 
 <td>创建ovsdb数据库</td> 
 <td>ovsdb-tool create /usr/local/share/openvswitch/conf.db /usr/local/share/openvswitch/vswitch.ovsschema</td> 
 </tr> 
 <tr> 
 <td>启动ovs-server</td> 
 <td>nohup ovsdb-server /usr/local/share/openvswitch/conf.db --remote=punix:/usr/local/var/run/openvswitch/db.sock --remote=ptcp:6640 --pidfile=ovsdb-server.pid &gt;&gt; /app/ovs/log.txt 2&gt;&amp;1 &amp;</td> 
 </tr> 
 <tr> 
 <td> </td> 
 <td>ovs-vsctl --no-wait init</td> 
 </tr> 
 <tr> 
 <td>启动ovs-switch</td> 
 <td>nohup ovs-vswitchd unix:/usr/local/var/run/openvswitch/db.sock -v --pidfile &gt;&gt; /app/ovs/switch.log 2&gt;&amp;1 &amp;</td> 
 </tr> 
 </tbody> 
</table>

进入配置部分

<table style=""> 
 <tbody> 
 <tr> 
 <td>配置虚拟机ABC的网络</td> 
 <td>A:192.168.0.11 B(两块网卡):192.168.0.16 192.168.0.18（eno33554992） &nbsp;C（两块网卡）:192.168.0.17 192.168.0.19（eno33554992）</td> 
 </tr> 
 <tr> 
 <td>虚拟机A</td> 
 <td>虚拟机A要能访问到B C</td> 
 </tr> 
 <tr> 
 <td>修改三台机器的系统参数</td> 
 <td>fs.aio-max-nr = 65536 net.bridge.bridge-nf-call-iptables = 1 net.bridge.bridge-nf-call-iptables = 1 net.bridge.bridge-nf-call-ip6tables = 1 net.ipv4.ip_forward = 1</td> 
 </tr> 
 <tr> 
 <td>网关配置</td> 
 <td>虚拟机BC的网关配置为虚拟机A的IP</td> 
 </tr> 
 <tr> 
 <td>基本要求</td> 
 <td>docker启动 &nbsp;虚拟机B --bip 192.168.16.0/24;虚拟机A --bip 192.168.17.0/24</td> 
 </tr> 
 <tr> 
 <td>每个docker上启动两个容器</td> 
 <td>docker run -d -it --name=test16y01 --privileged=true -v /app/docker/waigua/:/app/docker/waigua/ --net=none centos:08.21 /bin/bash</td> 
 </tr> 
 <tr> 
 <td> </td> 
 <td>安装ovs</td> 
 </tr> 
 <tr> 
 <td>虚拟机C上</td> 
 <td>ovs-vsctl add-br sdn-br0 ovs-vsctl set bridge sdn-br0 stp_enable=true ifconfig sdn-br0 192.168.16.2/24 up &nbsp;ovs-vsctl add-port sdn-br0 eno33554992</td> 
 </tr> 
 <tr> 
 <td>虚拟机D上</td> 
 <td>ovs-vsctl add-br sdn-br0 ovs-vsctl set bridge sdn-br0 stp_enable=true ifconfig sdn-br0 192.168.17.2/24 up &nbsp;ovs-vsctl add-port sdn-br0 eno33554992</td> 
 </tr> 
 <tr> 
 <td>虚拟机C上</td> 
 <td>提前下载pipwork<img alt="大哭" src="http://static.blog.csdn.net/xheditor/xheditor_emot/default/wail.gif"> &nbsp;./pipework sdn-br0 39f80cbc3c5a 192.168.16.6/24 这种命令形式，把两个容器添加上IP(192.168.16.6 192.168.16.7)</td> 
 </tr> 
 <tr> 
 <td>虚拟机D上</td> 
 <td>./pipework sdn-br0 39f80cbc3c5a 192.168.16.6/24 这种命令形式，把两个容器添加上IP(192.168.17.6 192.168.17.7)</td> 
 </tr> 
 <tr> 
 <td>测试网络</td> 
 <td>同一机器上的容器可以互通 ，跨机器就不通了</td> 
 </tr> 
 <tr> 
 <td>虚拟机C上</td> 
 <td>ovs-vsctl add-port sdn-br0 vxlan0 -- set interface vxlan0 type=vxlan options:remote_ip=192.168.0.17</td> 
 </tr> 
 <tr> 
 <td>虚拟机D上</td> 
 <td>ovs-vsctl add-port sdn-br0 vxlan0 -- set interface vxlan0 type=vxlan options:remote_ip=192.168.0.16</td> 
 </tr> 
 <tr> 
 <td>测试网络</td> 
 <td>不出意外，容器之间是通的了</td> 
 </tr> 
 </tbody> 
</table>

如有错误，或者问题，不要羞涩，请提问我，谢谢。![再见][bye.gif]

[shy.gif]: /images/20220609/68e821e9a94b4f66afbf5535b2b34cf6.png
[Center]: /images/20220609/87a11d95856246f3958356a2575c328e.png
[bye.gif]: /images/20220609/cb9d7856cd634447b51e1c2d6adadb32.png