CDH安装: rpm包+parcel

女爷i 2022-03-01 02:14 600阅读 0赞

*  由于网络不稳定，下载rpm包经常中断，不方便完成任务，所以通过wget下载：

nohup wget -t 0 -w 10 -c -r -nd -np  -L -p   http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/RPMS/x86_64/ &
     nohup wget -t 0 -w 10 -c -r -nd -np  -L -p   http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5/RPMS/noarch/ &
    
    -t,  --tries=NUMBER            set number of retries to NUMBER (0 unlimits)
    -w,  --wait=SECONDS            wait SECONDS between retrievals
    -nd, --no-directories           don’t create directories
    -np, --no-parent                 don’t ascend to the parent directory
    -c,  --continue                resume getting a partially-downloaded file.                         
    -L,  --relative                  follow relative links only.
    -p,  --page-requisites    get all images, etc. needed to display HTML page.

*  安装文档：[https://docs.cloudera.com/documentation/enterprise/5-12-x/topics/installation.html][https_docs.cloudera.com_documentation_enterprise_5-12-x_topics_installation.html]

### 文章目录 ###

*  1，cm 的rpm 包下载地址：
 *   *  a,　cm安装包下载
     *  b,　cm二进制文件
 *  2， 安装rpm包
 *  3，安装失败，卸载重装
 *  4，agent启动报错： Error, CM server guid updated
 *  5, 下载parcel文件，安装hadoop集群

# 1，cm 的rpm 包下载地址： #

## a,　cm安装包下载 ##

[http://archive.cloudera.com/cm5/redhat/7/x86\_64/cm/5.16/RPMS/x86\_64/][http_archive.cloudera.com_cm5_redhat_7_x86_64_cm_5.16_RPMS_x86_64]  
![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2V5ZW9mZWFnbGU_size_16_color_FFFFFF_t_70]

## b,　cm二进制文件 ##

[archive.cloudera.com/cm5/installer/5.16.1/cloudera-manager-installer.bin][archive.cloudera.com_cm5_installer_5.16.1_cloudera-manager-installer.bin]  
![在这里插入图片描述][20190321145030662.png]

# 2， 安装rpm包 #

install-cdh.sh

#安装jdk
    rpm -ivh jdk-6u31-linux-amd64.rpm
    rpm -ivh oracle-j2sdk1.7-1.7.0up+date67-1.x86_64.rpm
    ln -sf /usr/java/jdk1.7.0_67-cloudera/ /usr/java/jdk
    echo 'export JAVA_HOME=/usr/java/jdk'>> /etc/profile
    echo 'export PATH=$PATH:$JAVA_HOME/bin'>>/etc/profile
    source /etc/profile
    
    #安装cm-server,cm-agent
    rpm -ivh cloudera-manager-daemons-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
    rpm -ivh cloudera-manager-server-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
    rpm -ivh cloudera-manager-agent-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
    rpm -ivh cloudera-manager-server-db-2-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
    rpm -ivh enterprise-debuginfo-5.16.1-1.cm5161.p0.1.el7.x86_64.rpm
    
    # 安装cm
    chmod +x  cloudera-manager-installer.bin	
    ./cloudera-manager-installer.bin	
    
    ###依据提示： 关闭防火墙， 禁用selinux， 移除/etc/cloudera-scm-server/db.properties
    ###查看安装日志：
    [root@cdh ~]# ls /var/log/cloudera-manager-installer/
    0.check-selinux.log                         4.check-for-systemd.log
    10.delete-embedded-db.log                   4.remove-cloudera-manager-repository.log
    11.remove-cloudera-manager-server-db-2.log  5.install-cloudera-manager-server-db-2.log
    12.remove-cloudera-manager-server.log       6.daemon-reload.log
    13.remove-cloudera-manager-daemons.log      7.start-embedded-db.log
    14.remove-cloudera-manager-repository.log   8.start-scm-server.log
    1.install-repo-pkg.log                      9.stop-embedded-db.log
    2.install-oracle-j2sdk1.7.log               uninstall.log
    3.install-cloudera-manager-server.log
    
    ### cm使用的数据库：
    [root@cdh ~]# ls /etc/cloudera-scm-server
    db.mgmt.properties                  db.properties                  log4j.properties
    db.mgmt.properties.20190320-234106  db.properties.20190320-234106
    db.mgmt.properties.20190321-003144  db.properties.rpmsave
    
    [root@cdh ~]# cat /etc/cloudera-scm-server/db.properties
    # Auto-generated by initialize_embedded_db.sh
    # These are database settings for CM Manager
    com.cloudera.cmf.db.type=postgresql
    com.cloudera.cmf.db.host=localhost:7432
    com.cloudera.cmf.db.name=scm
    com.cloudera.cmf.db.user=scm
    com.cloudera.cmf.db.password=16zgvY6rs2
    com.cloudera.cmf.db.setupType=EMBEDDED
    
    #使用mysql作为元数据库，修改db.properties配置
    mv mysql-connector-java-5.1.39-bin.jar mysql-connector-java.jar
    cp mysql-connector-java.jar /usr/share/java

# 3，安装失败，卸载重装 #

/usr/share/cmf/uninstall-cloudera-manager.sh

# 4，agent启动报错： Error, CM server guid updated #

[01/Apr/2019 02:00:17 +0000] 16800 MainThread agent        ERROR    Error, CM server guid updated, expected d45ae888-ad12-489b-a08b-463ff64f918f, received 87a0fdcf-10b8-478d-b97e-13e7ca03a6d1
    
    ==解决： cloudera-scm-agent stop && /var/lib/cloudera-scm-agent/cm_guid &&  cloudera-scm-agent start

# 5, 下载parcel文件，安装hadoop集群 #

[http://archive.cloudera.com/cdh5/parcels/5.16/][http_archive.cloudera.com_cdh5_parcels_5.16]  
![在这里插入图片描述][20190321150025485.png]  
选择对应的版本下载后，放到/opt/cloudera/parcel-repo下， sha1文件重命名为sha文件

安装过程同cm解压安装，见[https://blog.csdn.net/eyeofeagle/article/details/82155363\#t5][https_blog.csdn.net_eyeofeagle_article_details_82155363_t5]

[https_docs.cloudera.com_documentation_enterprise_5-12-x_topics_installation.html]: https://docs.cloudera.com/documentation/enterprise/5-12-x/topics/installation.html
[http_archive.cloudera.com_cm5_redhat_7_x86_64_cm_5.16_RPMS_x86_64]: http://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.16/RPMS/x86_64/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2V5ZW9mZWFnbGU_size_16_color_FFFFFF_t_70]: /images/20220301/9e7cec8972794864abe9eecb7f630332.png
[archive.cloudera.com_cm5_installer_5.16.1_cloudera-manager-installer.bin]: http://archive.cloudera.com/cm5/installer/5.16.1/cloudera-manager-installer.bin
[20190321145030662.png]: /images/20220301/735770f409184256bc164e3ef4aa0db3.png
[http_archive.cloudera.com_cdh5_parcels_5.16]: http://archive.cloudera.com/cdh5/parcels/5.16/
[20190321150025485.png]: /images/20220301/ff6f8be8a1ad4a9b9cf8b79fd72b2a02.png
[https_blog.csdn.net_eyeofeagle_article_details_82155363_t5]: https://blog.csdn.net/eyeofeagle/article/details/82155363#t5