大数据集群之hbase2.1.0高可用安装配置

亦凉 2023-02-20 08:26 3阅读 0赞

### 一、安装准备 ###

下载地址：[http://archive.apache.org/dist/hbase/][http_archive.apache.org_dist_hbase]

HBase官方文档：[http://hbase.apache.org/book.html][http_hbase.apache.org_book.html]

ssh免密登录：[https://blog.csdn.net/qq262593421/article/details/105325593][https_blog.csdn.net_qq262593421_article_details_105325593]

zookeeper安装：[https://blog.csdn.net/qq262593421/article/details/106955485][https_blog.csdn.net_qq262593421_article_details_106955485]

hadoop集群安装：[https://blog.csdn.net/qq262593421/article/details/106956480][https_blog.csdn.net_qq262593421_article_details_106956480]

### 二、解压安装 ###

1、解压文件

cd /usr/local/hadoop
    tar zxpf hbase-2.1.0-bin.tar.gz

2、创建软链接

ln -s hbase-2.1.0 hbase

### 三、修改配置文件 ###

**regionservers**

regionservers配置和hadoop的work一样，hadoop的DataNode节点是哪个regionservers就是哪几个

hadoop003
    hadoop004
    hadoop005

**hbase-site.xml**

<?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <configuration>
    	
    	<property>	
    	  <name>hbase.master</name>
    	  <value>60000</value>
    	  
        </property>
      	<property>
          <name>hbase.tmp.dir</name>
          <value>/home/data/cluster/hbase/tmp</value>
      	</property>
      	<property>
    	  <name>hbase.rootdir</name>
    	  <value>hdfs://ns1/hbase</value>
    	</property>
    	<property>
    	  <name>hbase.cluster.distributed</name>
    	  <value>true</value>
    	</property>
    	<property>
    	  <name>hbase.zookeeper.property.clientPort</name>
    	  <value>2181</value>
    	</property>
    	<property>
    	  <name>hbase.zookeeper.quorum</name>
    	  <value>hadoop001,hadoop002,hadoop003</value>
    	  
    	</property>
    	<property>
    	  <name>hbase.zookeeper.property.dataDir</name>
    	  <value>/usr/local/zookeeper/data</value>
    	</property>
    	<property>
    	  <name>dfs.datanode.max.transfer.threads</name>
    	  <value>4096</value>
    	</property>
    	
    	
        <property>
    	  <name>hbase.unsafe.stream.capability.enforce</name>
    	  <value>false</value>
    	</property>
    	
    
    	
    
    	
    
    	
    	<property>
    	  <name>hfile.format.version</name>
    	  <value>3</value>
    	</property>
    	
    	<property>
    	  <name>hbase.superuser</name>
    	  <value>hbase,admin,root,hdfs,zookeeper,hive,hadoop,hue,impala,spark,kylin</value>
    	</property>
    	
    	
    	<property>
        	<name>hbase.coprocessor.user.region.classes</name>
        	<value>org.locationtech.geomesa.hbase.coprocessor.GeoMesaCoprocessor</value>
      	</property>
    	<property>  
    	   <name>hbase.table.sanity.checks</name>  
    	   <value>false</value>  
    	</property>
    	<property>  
    	   <name>hbase.coprocessor.abortonerror</name>  
    	   <value>false</value>  
    	</property>
    
    	 
    	<property>  
    	   <name>hfile.block.cache.size</name> 
    	   <value/>
    	
    	   <description>stofile的读缓存占用Heap的大小百分比。该值直接影响数据读的性能当然是越大越好，如果写比读少很多，开到0.4-0.5也没问题，如果读写均衡，设置为0.3左右。如果写比读多，果断使用默认就行。</description>
    	</property>
    
    
    </configuration>

**hbase-env.sh**

**hbase环境变量配置**

#!/usr/bin/env bash
    
    export HBASE_OPTS="-XX:+UseConcMarkSweepGC -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -Xloggc:/usr/local/hadoop/hbase/logs/jvm-gc-hbase.log"
    
    export JAVA_HOME=/usr/java/jdk1.8
    export HBASE_HEAPSIZE=4G
    
    export HADOOP_HOME=/usr/local/hadoop/hadoop
    export HBASE_HOME=/usr/local/hadoop/hbase
    export HBASE_CLASSPATH=/usr/local/hadoop/hadoop/etc/hadoop
    export HBASE_MANAGES_ZK=false
    export HBASE_PID_DIR=/var/hadoop/pids

**backup-masters**

启动hbase时会将配置的backup-masters节点作为备用HMaster

hadoop001
    hadoop002

### 四、环境变量配置 ###

编辑 /etc/profile 文件

vim /etc/profile

添加一下内容

export HBASE_HOME=/usr/local/hadoop/hbase
    export PATH=$PATH:$HBASE_HOME

### 五、启动hbase ###

start-hbase.sh

### 六、验证安装 ###

1、执行shell命令

hbase shell

create 'tb1','cmf1','cmf2','cmf3'
    list
    list_namespace

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70][]

2、访问web页面

[http://hadoop001:16010/master-status][http_hadoop001_16010_master-status]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 1][]

[http://hadoop002:16010/master-status][http_hadoop002_16010_master-status]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 2][]

[http_archive.apache.org_dist_hbase]: http://archive.apache.org/dist/hbase/
[http_hbase.apache.org_book.html]: http://hbase.apache.org/book.html
[https_blog.csdn.net_qq262593421_article_details_105325593]: https://blog.csdn.net/qq262593421/article/details/105325593
[https_blog.csdn.net_qq262593421_article_details_106955485]: https://blog.csdn.net/qq262593421/article/details/106955485
[https_blog.csdn.net_qq262593421_article_details_106956480]: https://blog.csdn.net/qq262593421/article/details/106956480
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20200625212314114.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx,size_16,color_FFFFFF,t_70
[http_hadoop001_16010_master-status]: http://hadoop001:16010/master-status
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20200625203545988.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx,size_16,color_FFFFFF,t_70
[http_hadoop002_16010_master-status]: http://hadoop002:16010/master-status
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/20200625203634913.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx,size_16,color_FFFFFF,t_70