CentOS-6安装mesos+marathon+zookeeper

╰半橙微兮° 2022-03-26 09:44 384阅读 0赞

## 前期准备 ##

### 关闭SELinux ###

> sudo vi /etc/selinux/config

将SELINUX=enforcing修改为SELINUX=disabled重启生效

### 关闭防火墙 ###

> sudo service iptables stop

### 配置hosts ###

> sudo vi /etc/hosts

/etc/hosts内容：

> 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4  
> ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6  
> 192.168.245.227 iot-node1  
> 192.168.245.228 iot-node2  
> 192.168.245.229 iot-node3

### 安装java ###

1）卸载CentOS自带的OpenJDK

> sudo rpm -e --nodeps $(sudo rpm -qa | grep java)

> sudo rpm -e --nodeps $(sudo rpm -qa | grep gcj)

> sudo rpm -e --nodeps $(sudo rpm -qa | grep jdk)

2）用cd命令进入到jdk-8u181-linux-x64.tar.gz所在目录,执行以下命令

> sudo tar -zxf jdk-8u181-linux-x64.tar.gz -C /opt

> sudo mv /opt/jdk1.8.0\_181 /opt/java

3）配置环境变量

> sudo vi /etc/profile

在/etc/profile的最后加入以下几行：

> JAVA\_HOME=/opt/java  
> CLASSPATH=.:$JAVA\_HOME/jre/lib/rt.jar:$JAVA\_HOME/lib/dt.jar:$JAVA\_HOME/lib/tools.jar  
> export JAVA\_HOME  
> export CLASSPATH  
> export PATH=$PATH:$JAVA\_HOME/bin

4）使环境变量生效

> source /etc/profile

5）设置java软连接

> sudo ln -sf /opt/java/bin/java /usr/bin/java

> sudo ln -sf /opt/java/bin/javac /usr/bin/javac

> sudo ln -sf /opt/java/bin/javaws /usr/bin/javaws

如果/usr/bin目录已存在java、javaws，删除/usr/bin目录下的java、javaws

然后执行上面的命令

## 离线安装zookeeper ##

### 下载地址 ###

> [http://mirrors.hust.edu.cn/apache/zookeeper/][http_mirrors.hust.edu.cn_apache_zookeeper]

### 安装包 ###

> zookeeper-3.4.13.tar.gz

### 安装zookeeper ###

1）进入到zookeeper-3.4.13.tar.gz所在目录

执行解压命令：

> sudo tar -zxf zookeeper-3.4.13.tar.gz -C /opt

2）修改文件夹名称：

> sudo mv /opt/zookeeper-3.4.13 /opt/zookeeper

3）创建文件夹：

> sudo mkdir /opt/zookeeper/data

> sudo mkdir /opt/zookeeper/logs

### 配置zookeeper ###

1）每个master节点设置不同的myid值

在/opt/zookeeper/data/myid中写入一个1到255范围的数值，需要注意的是，每个节点的myid不要重复。

> sudo vi /opt/zookeeper/data/myid

这里将3个master节点的myid分别设置为：1，2，3

2）修改配置：

> sudo cp /opt/zookeeper/conf/zoo\_sample.cfg /opt/zookeeper/conf/zoo.cfg

> sudo vi /opt/zookeeper/conf/zoo.cfg

修改dataDir=/var/lib/zookeeper为dataDir=/opt/zookeeper/data

在配置文件/opt/zookeeper/conf/zoo.cfg中加入下面内容：

> server.1= iot-node1:2888:3888  
> server.2= iot-node2:2888:3888  
> server.3= iot-node3:2888:3888

注意：iot-node1、iot-node2、iot-node3位主节点主机名

server.后的数字对应myid的内容

3）修改zookeeper日志路径

> sudo vi /opt/zookeeper/bin/zkEnv.sh

找到以下为内容：

> if \[ “x$\{ZOO\_LOG\_DIR\}” = “x” \]  
> then  
> ZOO\_LOG\_DIR="."  
> fi

修改为：

> if \[ “x$\{ZOO\_LOG\_DIR\}” = “x” \]  
> then  
> ZOO\_LOG\_DIR="" $ZOOBINDIR/…/logs  
> fi

### 注册zookeeper服务 ###

1）新建一个zookeeper脚本

> sudo touch /etc/rc.d/init.d/zookeeper

2）给脚本添加执行权限

> sudo chmod +x /etc/rc.d/init.d/zookeeper

3）编辑/etc/rc.d/init.d/zookeeper

> sudo vi /etc/rc.d/init.d/zookeeper  
> /etc/rc.d/init.d/zookeeper内容：  
> \#!/bin/bash  
> \#chkconfig:2345 20 90  
> \#description:zookeeper  
> \#processname:zookeeper  
> export JAVA\_HOME=/opt/java  
> case $1 in  
> start) sudo /opt/zookeeper/bin/zkServer.sh start;;  
> stop) sudo /opt/zookeeper/bin/zkServer.sh stop;;  
> status) sudo /opt/zookeeper/bin/zkServer.sh status;;  
> restart) sudo /opt/zookeeper/bin/zkServer.sh restart;;  
> \*) echo “require start|stop|status|restart” ;;  
> esac

### 启动/停止/查看zookeeper ###

> sudo service zookeeper start

> sudo service zookeeper stop

> sudo service zookeeper status

### 设置zookeeper开机自启 ###

> sudo chkconfig zookeeper on

### 查看开机自启服务 ###

> sudo chkconfig --list

## 离线安装mesos ##

### 下载地址 ###

> [https://open.mesosphere.com/downloads/mesos/][https_open.mesosphere.com_downloads_mesos]

### 安装包 ###

> mesos-1.6.1-2.0.1.el6.x86\_64.rpm

### 依赖包 ###

> apr-util-1.3.9-3.el6\_0.1.x86\_64.rpm  
> apr-util-1.3.9-3.el6\_0.1.x86\_64.rpm  
> cyrus-sasl-md5-2.1.23-15.el6\_6.2.x86\_64.rpm  
> gnutls-2.12.23-22.el6.x86\_64.rpm  
> libevent-1.4.13-4.el6.x86\_64.rpm  
> libevent-devel-1.4.13-4.el6.x86\_64.rpm  
> libevent-doc-1.4.13-4.el6.noarch.rpm  
> libevent-headers-1.4.13-4.el6.noarch.rpm  
> libproxy-0.3.0-10.el6.x86\_64.rpm  
> libproxy-bin-0.3.0-10.el6.x86\_64.rpm  
> libproxy-python-0.3.0-10.el6.x86\_64.rpm  
> neon-0.29.3-3.el6\_4.x86\_64.rpm  
> pakchois-0.4-3.2.el6.x86\_64.rpm  
> perl-URI-1.40-2.el6.noarch.rpm  
> subversion-1.6.11-15.el6\_7.x86\_64.rpm

### 安装mesos ###

进入到mesos安装包和依赖包所在目录执行命令：

> sudo rpm -ivh \*.rpm

### 配置mesos-master ###

1）每个master节点的/etc/mesos/zk配置文件中设置zk的地址

> sudo vi /etc/mesos/zk

/etc/mesos/zk内容：

> zk:// iot-node1:2181, iot-node2:2181, iot-node3:2181/mesos

2）/etc/mesos-master/quorum中设置quorum值

> sudo vi /etc/mesos-master/quorum

这个值要大于master数/2，这里master数为3，则要设为2

3）配置ip、hostname、port

> sudo vi /etc/mesos-master/ip

/etc/mesos-master/ip内容为当前宿主机IP

> sudo vi /etc/mesos-master/hostname

/etc/mesos-master/ hostname也配置当前宿主机IP

注意：hostname如果配置主机名，web ui会出现不停地弹出对话框，“Failed to connect to 192.168.245.227:5050",进行重新连接

也可以修改/etc/default/mesos-master

> sudo vi /etc/default/mesos-master

显示内容：

> PORT=5050

> ZK=\`cat /etc/mesos/zk\`

### 配置mesos-slave ###

1）每个master节点的/etc/mesos/zk配置文件中设置zk的地址

> sudo vi /etc/mesos/zk

/etc/mesos/zk内容：

> zk:// iot-node1:2181, iot-node2:2181, iot-node3:2181/mesos

3）配置ip、hostname

> sudo vi /etc/mesos-slave/ip

/etc/mesos- slave/ip内容为当前宿主机IP

> sudo vi /etc/mesos- slave/hostname

/etc/mesos- slave/hostname也配置当前宿主机IP

注意：hostname如果配置主机名，web ui会出现不停地弹出对话框，“Failed to connect to 192.168.245.227:5050",进行重新连接

4）修改mesos容器端口范围

mesos默认容器端口范围是31000 - 32000

> sudo vi /etc/mesos-slave/resources

/etc/mesos-slave/resources内容：

> ports(\*):\[1024-65534\]

也可以在mesos-slave启动命令后加上：

> –resources=ports(\*):\[1024-65534\]

注意：mesos- slave可与marathon、mesos-master安装在同一个宿主机

### 其他 ###

1）几个配置启动参数的目录：

> /etc/mesos-master/  
> /etc/mesos-slave/  
> /etc/marathon/conf/

在这些目录分别用来配置mesos-master，mesos-slave，marathon的启动参数。以参数名为文件名，参数值为文件内容即可。

2）Failed to perform recovery: Incompatible agent info detected.问题解决

> sudo rm -rf /var/log/mesos/\*

> sudo rm -rf /var/lib/mesos/meta/slaves/\*

重启mesos-slave

3）上面三条命令可重复执行，知道ui上不在报Failed to perform recovery:

> Incompatible agent info detected.问题

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 1]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 2]

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 3]

## 离线安装marathon ##

### 下载地址 ###

> [http://mesosphere.github.io/marathon/][http_mesosphere.github.io_marathon]

### 安装包 ###

> marathon-1.6.322.tgz

### 安装marathon ###

1）进入到marathon-1.6.322.tgz所在目录

执行解压命令：

> sudo tar -zxf marathon-1.6.322.tgz -C /opt

2）修改文件夹名称：

> sudo mv /opt/marathon-1.6.322-2bf46b341 /opt/marathon

### 配置marathon ###

1）创建文件夹

> sudo mkdir /opt/marathon/logs

> sudo mkdir /etc/marathon

2）配置zookeeper地址

> sudo vi /etc/marathon/zk

/etc/marathon/zk内容：

> zk://iot-node1:2181,iot-node2:2181,iot-node3:2181/marathon

3）配置mesos用户

> sudo vi /etc/marathon/mesos\_user

/etc/marathon/mesos\_user内容：

> hadoop

4）编辑启动脚本

> sudo vi /opt/marathon/bin/marathon-server

/opt/marathon/bin/marathon-server内容：

> MARATHON\_MASTER=\`cat /etc/mesos/zk\`  
> MARATHON\_ZK=\`cat /etc/marathon/zk\`  
> MARATHON\_MESOS\_USER=\`cat /etc/marathon/mesos\_user\`
> 
> nohup /usr/sbin/marathon --master $MARATHON\_MASTER --zk $MARATHON\_ZK  
> –mesos\_user $MARATHON\_MESOS\_USER > /opt/marathon/logs/marathon.out 2>&1  
> &

### 注册marathon服务 ###

1）新建一个marathon脚本

> sudo touch /etc/rc.d/init.d/marathon

2）给脚本添加执行权限

> sudo chmod +x /etc/rc.d/init.d/marathon

3）编辑/etc/rc.d/init.d/marathon

> sudo vi /etc/rc.d/init.d/marathon

/etc/rc.d/init.d/marathon内容：

> \#!/bin/bash  
> \#chkconfig:2345 20 90  
> \#description:marathon  
> \#processname:marathon  
> \#start marathon  
> start() \{  
> pid=$(ps -ef | grep marathon | grep mesosphere | grep -v grep | awk ‘\{print  
> $2\}’)  
> if \[ “$pid” == “” \]; then  
> sudo /opt/marathon/bin/marathon-server  
> fi  
> pid=$(ps -ef | grep marathon | grep mesosphere | grep -v grep | awk ‘\{print  
> $2\}’)  
> echo “marathon (pid “$pid”) is started”  
> \}  
> \#stop marathon  
> stop()\{  
> pid=$(ps -ef | grep marathon | grep mesosphere | grep -v grep | awk ‘\{print  
> $2\}’)  
> if \[ “$pid” != “” \]; then  
> sudo kill -9 $pid  
> fi  
> echo “marathon (pid “$pid”) is stopped”  
> \}  
> \#look status  
> status()\{  
> pid=$(ps -ef | grep marathon | grep mesosphere | grep -v grep | awk ‘\{print  
> $2\}’)  
> if \[ “$pid” != “” \]; then  
> echo “marathon (pid “$pid”) is running”  
> else  
> echo “marathon is not running”  
> fi  
> \}  
> \#restart marathon  
> restart()\{  
> stop  
> start  
> \}  
> case $1 in  
> start) start ;;  
> stop) stop ;;  
> status) status ;;  
> restart) restart ;;  
> \*) echo “require start|stop|status|restart” ;;  
> esac

### 启动/停止/查看marathon ###

> sudo service marathon start

> sudo service marathon stop

> sudo service marathon status

### 设置marathon开机自启 ###

> sudo chkconfig marathon on

### 查看开机自启服务 ###

> sudo chkconfig --list

[http_mirrors.hust.edu.cn_apache_zookeeper]: http://mirrors.hust.edu.cn/apache/zookeeper/
[https_open.mesosphere.com_downloads_mesos]: https://open.mesosphere.com/downloads/mesos/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70]: /images/20220326/74c19a7849054b748363e3e844a79b10.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 1]: /images/20220326/d38890f9db6946eab5ed09f08ef7fdf6.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 2]: /images/20220326/5cdb4e0a943e435e8575e70027f94d95.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3RvbnlfMzI4NDI3Njg1_size_16_color_FFFFFF_t_70 3]: /images/20220326/736cb37781164818a8a032c4052df2d5.png
[http_mesosphere.github.io_marathon]: http://mesosphere.github.io/marathon/