Centos7搭建FastDFS集群 超、凢脫俗 2022-01-15 12:59 324阅读 0赞 (这里将tracker和storage安装在了同一台机器,也可分开安装) 共需两台机器,既做tracker也做storage。(两台tracker节点是高可用关系不是负载均衡关系,storage未选择的那台则不工作) 若想搭建完全集群模式,可用6台机器进行实现,两台做tracker,四台做storage同时两两互为一个group(搭建过程同下) 公共部分 yum -y install make cmake gcc gcc-c++ wget https://github.com/happyfish100/libfastcommon/archive/V1.0.7.tar.gz libfastcommon是从 FastDFS 和 FastDHT 中提取出来的公共 C 函数库,基础环境 tar -zxvf V1.0.7.tar.gz cd libfastcommon-1.0.7/ ./make.sh ./make.sh install ln -s /usr/lib64/libfastcommon.so /usr/local/lib/libfastcommon.so FastDFS主程序设置的lib目录是/usr/local/lib,所以需要创建软链接 ln -s /usr/lib64/libfastcommon.so /usr/lib/libfastcommon.so ln -s /usr/lib64/libfdfsclient.so /usr/local/lib/libfdfsclient.so ln -s /usr/lib64/libfdfsclient.so /usr/lib/libfdfsclient.so cd .. wget https://github.com/happyfish100/fastdfs/archive/V5.05.tar.gz tar -zxvf V5.05.tar.gz cd fastdfs-5.05 ./make.sh ./make.sh install ln -s /usr/bin/fdfs_trackerd /usr/local/bin 服务脚本内需要用到的命令(或者sed -ri s@/usr/local/bin@/usr/bin@ /etc/init.d/fdfs_storaged 修改两个服务脚本) ln -s /usr/bin/fdfs_storaged /usr/local/bin ln -s /usr/bin/stop.sh /usr/local/bin ln -s /usr/bin/restart.sh /usr/local/bin 配置tracker跟踪器 在tracker机器上执行 cp /etc/fdfs/tracker.conf.sample /etc/fdfs/tracker.conf vim /etc/fdfs/tracker.conf store_lookup=2 集群上传文件时(0为轮询,1为指定一个固定组,2为向组空闲空间大的组上传文件) base_path=/fastdfs/tracker 数据和日志目录地址 http.server_port=80 mkdir -pv /fastdfs/tracker systemctl daemon-reload chkconfig --add fdfs_trackerd systemctl start fdfs_trackerd 配置storage存储器 在storage机器上执行(我是和tracker机器安装在了一台机器上) cp /etc/fdfs/storage.conf.sample /etc/fdfs/storage.conf vim /etc/fdfs/storage.conf group_name=group1 组名,第一组为group1,第二组为group2(因为只有两台机所以都是group1组,一个组内可以有多个storage) base_path=/fastdfs/storage 数据和日志目录地址 store_path0=/fastdfs/storage 逐一配置 store_path_count 个路径,索引号基于 0。如果不配置 store_path0,那它就和 base_path 对应的路径一样 tracker_server=192.168.131.156:22122 组内的storage会随机选择一个tracker当自己的主,当主tracker挂掉后会提升另外一个为自己的主(原本主上线后抢占) tracker_server=192.168.131.157:22122 http.server_port=80 与nginx整合时需要用到 mkdir -pv /fastdfs/storage systemctl daemon-reload systemctl start fdfs_storaged 配置文件中定义的tracker必须启动 tail -f /fastdfs/storage/logs/storaged.log 查看日志,选择哪个tracker当主,以及和组内成员之间的通信信息 usr/bin/fdfs_monitor /etc/fdfs/storage.conf 查看集群信息 与nginx整合(storage节点上执行) wget https://jaist.dl.sourceforge.net/project/fastdfs/FastDFS%20Nginx%20Module%20Source%20Code/fastdfs-nginx-module_v1.16.tar.gz tar -xvf fastdfs-nginx-module_v1.16.tar.gz 所需要添加的模块 vim fastdfs-nginx-module/src/config 修改第四行为这个 CORE_INCS="$CORE_INCS /usr/include/fastdfs /usr/include/fastcommon/" yum -y install pcre-devel openssl-devel zlib-devel 编译安装nginx useradd -r nginx tar xzvf nginx-1.14.2.tar.gz 安装包在nginx官网下载(放在和上面下载的模块同一目录下) cd nginx-1.14.2/ ./configure --prefix=/usr/local/nginx --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --modules-path=/usr/lib64/nginx/modules --http-log-path=/var/log/nginx/access.log --pid-path=/var/run/nginx.pid --lock-path=/var/run/nginx.lock --user=nginx --group=nginx --with-http_ssl_module --with-http_v2_module --with-http_dav_module --with-http_stub_status_module --with-threads --with-file-aio --add-module=/root/fastdfs-nginx-module/src/ make && make install cp -rf /usr/local/nginx/sbin/nginx /usr/sbin/ cp /root/fastdfs-nginx-module/src/mod_fastdfs.conf /etc/fdfs/ vim /etc/fdfs/mod_fastdfs.conf connect_timeout=10 连接超时时间 tracker_server=192.168.131.156:22122 tracker_server=192.168.131.157:22122 url_have_group_name = true 如果文件ID的uri中包含/group**,则要设置为true store_path0=/fastdfs/storage Storage 配置的store_path0路径,必须和storage.conf中的一致 group_name=group1 组名(在同一组内的storage的组名一致) group_count = 1 一共有几个组 (有几个组就写几个,比如4台storage两两一组则数字就为2) [group1] 最后一行添加(若有多个组则添加多个) group_name=group1 storage_server_port=2300 store_path_count=1 store_path0=/fastdfs/storage cp /root/fastdfs-5.05/conf/{http.conf,mime.types} /etc/fdfs/ ln -s /fastdfs/storage/data/ /fastdfs/storage/data/M00 vim /etc/nginx/nginx.conf listen 80 端口值是要与 /etc/fdfs/storage.conf 中的 http.server_port=80 (前面改成80了)相对应。 location ~/group([0-9])/M00 { ngx_fastdfs_module; } vim /usr/lib/systemd/system/nginx.service nginx启动服务配置 [Unit] Description=The nginx HTTP and reverse proxy server After=network.target remote-fs.target nss-lookup.target [Service] Type=forking PIDFile=/run/nginx.pid ExecStartPre=/usr/bin/rm -f /run/nginx.pid ExecStartPre=/usr/sbin/nginx -t ExecStart=/usr/sbin/nginx ExecReload=/bin/kill -s HUP $MAINPID KillSignal=SIGQUIT TimeoutStopSec=5 KillMode=process PrivateTmp=true [Install] WantedBy=multi-user.target systemctl daemon-reload systemctl start nginx 测试上传文件以及访问(在任意一个tracker端进行) cp /etc/fdfs/client.conf.sample /etc/fdfs/client.conf vim /etc/fdfs/client.conf base_path=/fastdfs/client tracker_server=192.168.131.156:22122 tracker_server=192.168.131.157:22122 mkdir -pv /fastdfs/client fdfs_upload_file /etc/fdfs/client.conf /root/653798961.jpg 命令+配置文件路径+上传的文件所在的路径 group1/M00/00/00/wKiDnV0AeCKAIKQ6AAAHq8MyJVo908.jpg 在同一group的storage节点的/fastdfs/storage/data/00/00/wKiDnV0AeCKAIKQ6AAAHq8MyJVo908.jpg 内 返回的文件ID由group、存储目录、两级子目录、fileid、文件后缀名(由客户端指定,主要用于区分文件类型)拼接而成。可在存储节点上查看 与nginx整合后在网页上可通过该storage节点的ip+路径访问 比如我上面上传的文件 http://192.168.131.157/group1/M00/00/00/wKiDnV0AeCKAIKQ6AAAHq8MyJVo908.jpg
还没有评论,来说两句吧...