HiveServer2负载均衡

Love The Way You Lie 2024-02-21 10:09 67阅读 0赞

有多个HiveServer2服务时，可以借助Zookeeper服务实现访问HiveServer2的负载均衡，将HiveServer2的压力分担到多个节点上去。本文详细介绍HiveServer2负载均衡的配置及使用方法，请根据EMR集群（普通集群和Kerberos集群）的实际情况进行选择。  
![在这里插入图片描述][4f2b70e5ae0a40a4b79837d3272ce0c8.png]

hive.server2.support.dynamic.service.discovery  
设置为ture

在zooperker要创建相应的zooKeeperNamespace并赋权

create /hiveserver2 world:anyone:cdrwa

还有一些其他的配置参数：

编辑hive-site.xml
    
    <property>
        <name>spark.deploy.recoveryMode</name>
        <value>ZOOKEEPER</value>
     </property-->
    
    
    <property>
    	<name>hive.server2.support.dynamic.service.discovery</name>
    	<value>true</value>
    </property>
    
    
    
    <property>
    <name>hive.server2.zookeeper.namespace</name>
    <value>hiveserver2_zk</value>
    </property>
    
    
    <property>
    <name>hive.zookeeper.quorum</name>
    <value>node5:2181,node4:2181,node3:2181</value>
    </property>
    
    
    <property>
    <name>hive.zookeeper.client.port</name>
    <value>2181</value>
    </property>
    
    
    <property>
    <name>hive.server2.thrift.bind.host</name>
    <value>0.0.0.0</value>
    </property>
    <property>
    <name>hive.server2.thrift.port</name>
    <value>10000</value> //两个HiveServer2实例的端口号要一致
    </property>

重启hive服务

就可以去进行连接连接的测试  
beeline -u ‘jdbc:hive2://master-1-1:2181,master-1-2:2181,master-1-3:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2’

[4f2b70e5ae0a40a4b79837d3272ce0c8.png]: https://image.dandelioncloud.cn/pgy_files/images/2024/02/21/7e00fd026c434c3192d4be525fd032b3.png