Sqoop安装

素颜马尾好姑娘i 2023-02-08 15:55 8阅读 0赞

1.下载并解压  
1)链接：https://pan.baidu.com/s/1xHy8CQbH7KBydrOpGmkokA  
提取码：wyu8

2）上传安装包 sqoop-1.4.6.bin\_\_hadoop-2.0.4-alpha.tar.gz 到 hadoop12 的/export/software 路径中

tar -zxvf sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz -C /export/module/

4）解压 sqoop 安装包到指定目录，如：

mv sqoop-1.4.6.bin__hadoop-2.0.4-alpha/ sqoop

2.修改配置文件

1.  进入到/export/servers/sqoop/conf

mv sqoop-env-template.sh sqoop-env.sh

1.  修改配置文件

vim sqoop-env.sh

增加如下内容 
    export HADOOP_COMMON_HOME=/export/servers/hadoop-2.7.7
    export HADOOP_MAPRED_HOME=/export/servers/hadoop-2.7.7
    export HIVE_HOME=/export/servers/hive 
    export ZOOKEEPER_HOME=/export/servers/zookeeper-3.4.10 
    export ZOOCFGDIR=/export/servers/zookeeper-3.4.10/conf 
    export HBASE_HOME=/export/servers/hbase

3.拷贝 JDBC 驱动  
进入到/export/software/mysql-libs 路径，解压 mysql-connector-java-5.1.27.tar.gz 到当前路径

tar -zxvf mysql-connector-java-5.1.27.tar.gz

2）进入到/export/software/mysql-libs/mysql-connector-java-5.1.27 路径，拷贝 jdbc 驱动到 sqoop 的 lib 目录下。

cp mysql-connector-java-5.1.27-bin.jar /export/servers/sqoop/lib/

4.验证 Sqoop  
我们可以通过某一个 command 来验证 sqoop 配置是否正确:

bin/sqoop help

出现一些 Warning 警告（警告信息已省略），并伴随着帮助命令的输出：

Available commands:
      codegen            Generate code to interact with database records
      create-hive-table     Import a table definition into Hive
      eval               Evaluate a SQL statement and display the results
      export             Export an HDFS directory to a database table
      help               List available commands
      import             Import a table from a database to HDFS
      import-all-tables     Import tables from a database to HDFS
      import-mainframe    Import datasets from a mainframe server to HDFS
      job                Work with saved jobs
      list-databases        List available databases on a server
      list-tables           List available tables in a database
      merge              Merge results of incremental imports
      metastore           Run a standalone Sqoop metastore
      version            Display version information

5.测试Sqoop是否能够成功连接数据库

bin/sqoop list-databases --connect jdbc:mysql://hadoop12:3306/ --username root --password xxxxxx

出现如下输出：

information_schema
    metastore
    mysql
    oozie
    performance_schema