Hadoop 3.2.2 编译成功的过程

深碍√TFBOYSˉ_ 2023-01-22 05:00 1阅读 0赞

需要的环境：

centos7.7

jdk-8u231-linux-x64.tar.gz （hadoop 3.3.x需要的java版本为 jdk 1.8）

[https://www.oracle.com/java/technologies/javase/javase-jdk8-downloads.html][https_www.oracle.com_java_technologies_javase_javase-jdk8-downloads.html]

apache-maven-3.8.1-bin.tar.gz

[https://maven.apache.org/download.cgi][https_maven.apache.org_download.cgi]

protobuf-2.5.0.tar.gz（只能使用2.5.0版本）

[https://github.com/protocolbuffers/protobuf/releases/tag/v2.5.0][https_github.com_protocolbuffers_protobuf_releases_tag_v2.5.0]  
cmake3.20.2

[https://cmake.org/files/v3.20/cmake-3.20.2.tar.gz][https_cmake.org_files_v3.20_cmake-3.20.2.tar.gz]

apache-ant-1.10.10-bin.tar.gz

[https://ant.apache.org/bindownload.cgi][https_ant.apache.org_bindownload.cgi]

findbugs-3.0.1.tar.gz

[http://findbugs.sourceforge.net/downloads.html][http_findbugs.sourceforge.net_downloads.html]

hadoop-3.2.2-src.tar.gz

[https://archive.apache.org/dist/hadoop/common/hadoop-3.2.2/hadoop-3.2.2-src.tar.gz][https_archive.apache.org_dist_hadoop_common_hadoop-3.2.2_hadoop-3.2.2-src.tar.gz]

安装依赖包：

yum install gcc gcc-c++ gcc-header make autoconf automake libtool curl lzo-devel zlib-devel openssl openssl-devel ncurses-devel snappy snappy-devel bzip2 bzip2-devel lzo lzo-devel lzop libXtst zlib -y

解压文件：

tar -zxvf jdk-8u201-linux-x64.tar.gz

tar -zxvf protobuf-2.5.0.tar.gz
    cd protobuf-2.5.0
    ./configure &&
    make &&
    make check &&
    make install
    
    
    
    ldconfig

tar -zxvf apache-ant-1.10.10-bin.tar.gz

tar -zxvf findbugs-3.0.1.tar.gz

tar -zxvf cmake-3.20.2-linux-x86_64.tar.gz

tar -zxvf hadoop-3.3.0-src.tar.gz

编辑/etc/profile：

export JAVA_HOME=/mine/jdk1.8.0_201
    export PROTOBUF_HOME=/mine/protobuf-2.5.0
    export MAVEN_HOME=/mine/apache-maven-3.8.1
    export CMAKE_HOME=/mine/cmake-3.20.2-linux-x86_64
    export ANT_HOME=/mine/apache-ant-1.10.10
    export FIND_BUGS_HOME=/mine/findbugs-3.0.1
    export PATH=$JAVA_HOME/bin:$PROTOBUF_HOME:$MAVEN_HOME/bin:$CMAKE_HOME/bin:$ANT_HOME/bin:$FIND_BUGS_HOME/bin:$PATH

cd hadoop-3.3.0-src：

mvn clean package -DskipTests -Pdist,native -Dtar

这个过程需要30分钟！！！

[https_www.oracle.com_java_technologies_javase_javase-jdk8-downloads.html]: https://www.oracle.com/java/technologies/javase/javase-jdk8-downloads.html
[https_maven.apache.org_download.cgi]: https://maven.apache.org/download.cgi
[https_github.com_protocolbuffers_protobuf_releases_tag_v2.5.0]: https://github.com/protocolbuffers/protobuf/releases/tag/v2.5.0
[https_cmake.org_files_v3.20_cmake-3.20.2.tar.gz]: https://cmake.org/files/v3.20/cmake-3.20.2.tar.gz
[https_ant.apache.org_bindownload.cgi]: https://ant.apache.org/bindownload.cgi
[http_findbugs.sourceforge.net_downloads.html]: http://findbugs.sourceforge.net/downloads.html
[https_archive.apache.org_dist_hadoop_common_hadoop-3.2.2_hadoop-3.2.2-src.tar.gz]: https://archive.apache.org/dist/hadoop/common/hadoop-3.2.2/hadoop-3.2.2-src.tar.gz