HBase 安装与配置

太过爱你忘了你带给我的痛 2022-02-21 05:10 436阅读 0赞

### 前言 ###

作为谷歌三剑客中`BigTable`的开源实现, `HBase`也是大数据领域必不可少的一环. 本章主要讲解如何安装`HBase`.

--------------------

### 前置条件 ###

*  JDK
 *  Hadoop
 *  ZooKeepr(可以选择`HBase`自带)

--------------------

### 安装流程 ###

`Mac`上可以选择使用`homebrew`进行安装, 也可以选择手动安装. 为了了解其中的配置流程, 我选择手动安装. 当然, 如果你觉得手动安装过于繁琐, 你可以参考[Mac安装HBase][Mac_HBase]这篇文章, 进行安装.

#### 手动安装 ####

手动安装`HBase`主要有如下几个流程:

*  下载安装文件, 并解压, 创建软连接.
 *  配置环境变量(为了使用更加方便).
 *  配置相关配置文件.

OK. 下面我们详细讲述下面的几个流程:

*  下载安装文件.
    
     *  `0.x`版本的下载地址为http://archive.apache.org/dist/hadoop/hbase/
     *  `2.x`版本的下载地址为http://mirrors.tuna.tsinghua.edu.cn/apache/hbase/hbase-1.2.11/hbase-1.2.11-bin.tar.gz  
        ![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70]  
        就笔者下载时, `HBase`已经发展到`2.x`版本, 但是开源的初期版本不是特别稳定. 所以使用`1.2.11`作为本章的安装对象.
 *  解压, 配置环境变量.

# 解压 配置软连接
    tar -zxvf hbase-1.2.11-bin.tar.gz
    ln -s /Users/Sean/Software/HBase/ hbase-1.2.11-bin current

#/etc/profile 文件
    export HBASE_HOME=/Users/Sean/Software/HBase/current
    export PATH=$PATH:$HBASE_HOME/bin
    
    # 配置完成后, wq! 强制写入
    # 配置完成后 source /etc/profile 文件立即生效
    
    # 验证配置完成 输入hbase命令即可
    localhost:HBase Sean$ hbase
    Usage: hbase [<options>] <command> [<args>]
    Options:
      --config DIR    Configuration direction to use. Default: ./conf
      --hosts HOSTS   Override the list in 'regionservers' file
      --auth-as-server Authenticate to ZooKeeper using servers configuration
    
    Commands:
    Some commands take arguments. Pass no args or -h for usage.
      shell           Run the HBase shell
      hbck            Run the hbase 'fsck' tool
      snapshot        Create a new snapshot of a table
      snapshotinfo    Tool for dumping snapshot information
      wal             Write-ahead-log analyzer
      hfile           Store file analyzer
      zkcli           Run the ZooKeeper shell
      upgrade         Upgrade hbase
      master          Run an HBase HMaster node
      regionserver    Run an HBase HRegionServer node
      zookeeper       Run a Zookeeper server
      rest            Run an HBase REST server
      thrift          Run the HBase Thrift server
      thrift2         Run the HBase Thrift2 server
      clean           Run the HBase clean up script
      classpath       Dump hbase CLASSPATH
      mapredcp        Dump CLASSPATH entries required by mapreduce
      pe              Run PerformanceEvaluation
      ltt             Run LoadTestTool
      version         Print the version
      CLASSNAME       Run the class named CLASSNAME

*  配置文件
    
     *  配置文件 `regionservers` 配置的为所有结点主机名
     *  配置文件 `hbase-env.sh` 配置的是`Hadoop`的classpath, 以及`ZooKeeper`的相关内容.
     *  配置文件`hbase-site.xml` 配置的是`HBase`自身的相关配置.  
        其配置文件内容如下:

# regionservers 
    # 单机就配置为localhost
    localhost

# hbase-env.sh
    export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home
    export HBASE_CLASSPATH=/Users/Sean/Software/hadoop/hadoop-2.7.5/conf
    # 老版本说需要配置JAVA_CLASSPATH 我没遇到
    #export JAVA_CLASSPATH=.:$JAVA_HOME/lib/dt.jar;$JAVA_HOME/lib/tools.jar
    # JVM参数
    export HBASE_OPTS="-XX:+UseConcMarkSweepGC"
    # 使用自身的ZooKeeper设置为 false, 使用自带ZooKeeper使用为true
    export HBASE_MANAGES_ZK=false

# habse-site.xml
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    <configuration>
    	
      <property>
        <name>hbase.rootdir</name>
        <value>hdfs://localhost:9000/hbase</value>
      </property>
    
      
      
      <property>
        <name>hbase.cluster.distributed</name>
        <value>true</value>
      </property>
    
      
      
      <property>
        <name>hbase.zookeeper.quorum</name>
        <value>localhost:2181,localhost:2182,localhost:2183</value>
      </property
    
    </configuration>

*  保存, 使用`bin/start-hbase.sh`启动`HBase`.

./bin/start-hbase.sh

完成后的`ZK`与`Hadoop`上会创建相应的结点:  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 1]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 2]  
`HBase 1.x` 端口改成了 `16010`. 访问 [http://localhost:16010][http_localhost_16010] . `0.x`版本是`60010`.

[HBase无法访问60010端口？？？][HBase_60010]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 3]  
访问`ReginonServer` . 这个地址我是通过`jps -lm`命令查询出来的. [http://localhost:16301/rs-status][http_localhost_16301_rs-status]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 4]

--------------------

### Q&A ###

`Hbase` 所有相关日志都在 `logs/`目录下, 可以看下问题.

*  ZooKeeper链接不上.

2019-04-09 21:07:40,357 INFO  [main-SendThread(localhost:2183)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2183. Will not attempt to authenticate using SASL (unknown error)
    2019-04-10 03:55:41,140 INFO  [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
    2019-04-10 03:55:50,642 INFO  [regionserver/localhost/127.0.0.1:16201-SendThread(localhost:2182)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2182. Will not attempt to authenticate using SASL (unknown error)
    2019-04-10 13:27:55,285 INFO  [regionserver/localhost/127.0.0.1:16201-SendThread(localhost:2183)] zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2183. Will not attempt to authenticate using SASL (unknown error)

解决措施: 貌似, 自带的ZK没有链接上. 查看端口是否占用, 或者更换本地的`ZooKeeper`即可.  
[zookeeper 入坑二： Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to aut][zookeeper _ Opening socket connection to server localhost_127.0.0.1_2181. Will not attempt to aut]  
[zookeeper的Will not attempt to authenticate using SASL (无法定位登录配置)][zookeeper_Will not attempt to authenticate using SASL]

--------------------

### Reference ###

\[1\]. [毕业生浅谈Google架构][Google]  
\[2\]. [(这篇挺好)HBase介绍、搭建、环境、安装部署][HBase]  
\[3\]. [HBase参数配置及说明][HBase 1]  
\[4\]. [HBase环境搭建60010端口无法访问问题解决方案][HBase_60010 1]  
\[5\]. [HBase 超详细介绍][HBase 2]  
\[6\]. [HBase集成Zookeeper集群部署][HBase_Zookeeper]  
\[7\]. [HBase介绍及简易安装][HBase 3]  
\[8\]. [HBase-单机模式安装][HBase-]  
\[9\]. [HBase核心知识点总结][HBase 4]

[Mac_HBase]: https://blog.csdn.net/vbirdbest/article/details/88232702
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70]: /images/20220221/8ca07a0859b04991bda992593f5a7407.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 1]: /images/20220221/a29bfb5c9cdd4b9a89595b59860e18c0.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 2]: /images/20220221/9c799d79d9d841a4a8dfc72d49d4cc27.png
[http_localhost_16010]: http://localhost:16010
[HBase_60010]: https://ask.csdn.net/questions/177926
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 3]: /images/20220221/b8273943c753454faee1112f5c786184.png
[http_localhost_16301_rs-status]: http://localhost:16301/rs-status
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly95YW54bWwuYmxvZy5jc2RuLm5ldA_size_16_color_FFFFFF_t_70 4]: /images/20220221/f901de2889f2450aaf20325ad1ad5ba0.png
[zookeeper _ Opening socket connection to server localhost_127.0.0.1_2181. Will not attempt to aut]: https://blog.csdn.net/qq_32447321/article/details/80869078
[zookeeper_Will not attempt to authenticate using SASL]: https://lavafree.iteye.com/blog/1723143
[Google]: https://www.xuebuyuan.com/144535.html
[HBase]: https://www.cnblogs.com/oraclestudy/articles/5665780.html
[HBase 1]: https://www.cnblogs.com/nexiyi/p/hbase_config_94.html
[HBase_60010 1]: https://blog.csdn.net/u013575812/article/details/46919011
[HBase 2]: https://www.cnblogs.com/charlist/p/7063991.html
[HBase_Zookeeper]: https://www.cnblogs.com/freeweb/p/5526080.html
[HBase 3]: https://www.cnblogs.com/nexiyi/p/hbase_intro_94.html
[HBase-]: https://blog.csdn.net/y472360651/article/details/79017308
[HBase 4]: https://www.cnblogs.com/caiyisen/p/7424177.html