亿级流量电商详情页系统实战-34.Storm部署

深碍√TFBOYSˉ_ 2022-10-30 06:27 209阅读 0赞

# 1.环境准备 #

## 1.1 安装Java 7 ##

## 1.2 Python 2.6.6 ##

# 2.部署 #

## 2.1 下载storm安装包 ##

*  下载apache-storm-1.1.0.tar.gz上传至
 *  解压缩
    
        # cd /usr/local
        # tar -zxf apache-storm-1.1.0.tar.gz
        # mv apache-storm-1.1.0 storm-1.1.0
 *  配置环境变量

#vi ~/.bashrc
    	export STORM_HOME=/usr/local/storm-1.1.0
    	export PATH=$PATH:$JAVA_HOME/bin:$ZOOKEEPER_HOME/bin:$SCALA_HOME/bin:$TORM_HOME/bin
    #source ~/.bashrc

## 2.2 修改storm配置文件 ##

# mkdir -p /var/storm
    # vi /usr/local/storm-1.1.0/conf/storm.yaml
    storm.zookeeper.servers:
        - "192.168.135.126"
        - "192.168.135.129"
        - "192.168.135.130"
        
    nimbus.seeds: ["192.168.135.135"]
    
    storm.local.dir: "/var/storm"
    
    #slots.ports：指定每个机器上可以启动多少个worker，一个端口号代表一个worker
    supervisor.slots.ports:
        - 6700
        - 6701
        - 6702
        - 6703

## 2.3 加入开机计划 ##

#vim /etc/rc.d/rc.local 
    nohup /usr/local/storm-1.1.0/bin/storm nimbus >/dev/null 2>&1 &  #一个节点上
    nohup /usr/local/storm-1.1.0/bin/storm supervisor >/dev/null 2>&1 &  #三个节点上
    nohup /usr/local/storm-1.1.0/bin/storm ui >/dev/null 2>&1 &  #一个节点上
    nohup /usr/local/storm-1.1.0/bin/storm logviewer >/dev/null 2>&1 &  #二个节点上
    #chmod +x /etc/rc.d/rc.local

## 2.4 启动 ##

#nohup /usr/local/storm-1.1.0/bin/storm nimbus >/dev/null 2>&1 & #在nimbus节点上启动
    #nohup /usr/local/storm-1.1.0/bin/storm supervisor >/dev/null 2>&1 & #三个节点上
    #nohup /usr/local/storm-1.1.0/bin/storm ui >/dev/null 2>&1 & #在nimbus节点上启动
    #nohup /usr/local/storm-1.1.0/bin/storm logviewer >/dev/null 2>&1 & #在nimbus节点上启动
    
    #jps
    
    4176 Supervisor
    4323 core  -- strom ui
    4025 nimbus

## 2.5 访问strom ui ##

http://192.168.135.135:8080/index.html

# 3.提交作业到storm集群 #

## 3.1 打JAR包 ##

mvn package

## 3.2 提交作业 ##

#storm jar storm-helloworld-0.0.1-SNAPSHOT.jar com.roncoo.eshop.storm.WordCountTopology WordCountTopology

## 3.3 在storm ui上观察storm作业的运行 ##

http://192.168.135.135:8080/index.html  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 1]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 2]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 3]

## 3.2 kill掉某个storm作业 ##

# storm kill WordCountTopology

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70]: /images/20221024/097a206f04254a348f4cf407f5f6266a.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 1]: /images/20221024/1f622ba766024a1fbe54d2e191521cab.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 2]: /images/20221024/703daf1daad143bab6b327a8e25aaf49.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80Mjg2ODYzOA_size_16_color_FFFFFF_t_70 3]: /images/20221024/049edfb1d8df42e0b11fee494b1e0ba8.png