Windows系统搭建Storm 分布式实时计算开发环境

傷城~ 2023-06-12 04:22 2阅读 0赞

### 1.准备工作 ###

1.1 下载Storm [apache-storm-2.0.0下载][apache-storm-2.0.0]

1.2 下载安装 zookeeper 步骤详看本人博客 [Window系统下搭建Zookeeper和Kafka环境][Window_Zookeeper_Kafka]

1.3 下载python

### 2. 安装Storm环境 ###

2.1 下载解压Storm，默认配置即可，如有需要可修改D:\\storm-2.0.0\\conf 目录的storm.yaml文件

2.2 启动Storm环境

2.2.1 启动zookeeper服务

zkserver

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70][]

2.2.2 进入安装目录/bin（D:\\storm-2.0.0\\bin）,分别启动Nimbus、Supervisor、Storm UI Daemons

**启动 Nimbus:**

storm.py nimbus

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 1][]

**启动 Supervisor:**

storm.py supervisor

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 2][]

**启动 Storm UI**

storm.py ui

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 3][]

### 3.测试 ###

启动完毕,输入http://localhost:8080/访问

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 4][]

###  ###

### **4.Storm与Hadoop的区别** ###

Hadoop是批处理框架，适合处理大量的离线数据，而Storm是流式处理框架，适合需要及时性的数据处理，可以做到随着数据的变化而不断对数据进行处理，并更新结果。

[apache-storm-2.0.0]: http://mirror.bit.edu.cn/apache/storm/apache-storm-2.0.0/apache-storm-2.0.0.zip
[Window_Zookeeper_Kafka]: https://blog.csdn.net/linhaiyun_ytdx/article/details/82902209
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70]: /images/20230531/b42715afeb444522a490379298954119.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 1]: /images/20230531/d46bce6d68b7434c963c3f5b420db6fe.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 2]: /images/20230531/c49001ae59f442de925be3cdab5fda28.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 3]: /images/20230531/65cfee18db5f452c91e52fc6974748f4.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2xpbmhhaXl1bl95dGR4_size_16_color_FFFFFF_t_70 4]: /images/20230531/b6d57d6118ca497582449df69895dd5c.png