flink搭建集群（一主三从）

痛定思痛。 2023-10-06 12:21 12阅读 0赞

## 配置 ##

![在这里插入图片描述][20200704104756582.png]

*  配置flink-conf.yaml

vim flink-conf.yaml

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70]

*  配置从节点

vim slaves

![在这里插入图片描述][20200704104848525.png]  
配置高可用时还需配置`masters`配置文件。

*  分发到其他节点：

scp -r flink-1.9.2 node02:`pwd`
    scp -r flink-1.9.2 node03:`pwd`
    scp -r flink-1.9.2 node04:`pwd`

![在这里插入图片描述][20200704105036608.png]

*  配置环境变量：

vim ~/.bashrc
    source ~/.bashrc

![在这里插入图片描述][20200704105332305.png]

## 启动flink ##

cd bin

![在这里插入图片描述][20200704105611919.png]

./start-cluster.sh

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 1]

*  主节点jps  
    `StandcloneSessionClusterEntrypoint`就是`JobManager`  
    ![在这里插入图片描述][20200704105937606.png]
 *  从节点jps  
    `TaskManagerRunner`就是`TaskManager`  
    ![在这里插入图片描述][20200704105908145.png]

## web ui ##

*  默认的`web ui`的端口是`8081`，在`flink-conf.yaml`中配置  
    ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 2]
 *  `Task Managers`  
    ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 3]  
    可管理的内存：  
    `Task Manager`本身需要占用一部分内存，所以实际可用内存肯定比设置的要低  
    ![在这里插入图片描述][20200704110827901.png]  
    一般建议`slot:cores=1:1`

[20200704104756582.png]: https://img-blog.csdnimg.cn/20200704104756582.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200704104642278.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk=,size_16,color_FFFFFF,t_70
[20200704104848525.png]: https://img-blog.csdnimg.cn/20200704104848525.png
[20200704105036608.png]: https://img-blog.csdnimg.cn/20200704105036608.png
[20200704105332305.png]: https://img-blog.csdnimg.cn/20200704105332305.png
[20200704105611919.png]: https://img-blog.csdnimg.cn/20200704105611919.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200704105747344.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk=,size_16,color_FFFFFF,t_70
[20200704105937606.png]: https://img-blog.csdnimg.cn/20200704105937606.png
[20200704105908145.png]: https://img-blog.csdnimg.cn/20200704105908145.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200704110439246.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk=,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70 3]: https://img-blog.csdnimg.cn/20200704110704104.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk=,size_16,color_FFFFFF,t_70
[20200704110827901.png]: https://img-blog.csdnimg.cn/20200704110827901.png