高可用集群搭建系列文章之六：Sqoop搭建

客官°小女子只卖身不卖艺 2023-06-06 03:43 11阅读 0赞

本篇文章主要介绍Sqoop的搭建，Sqoop在任一节点安装即可。

# 1、下载安装包，并解压 #

[下载地址][Link 1]  
解压命令如下：

tar -zxvf sqoop-1.4.5.bin__hadoop-2.0.4.tar.gz

# 2、配置/etc/profile #

export SQOOP_HOME=/home/hadoop/app/sqoop/sqoop-1.4.5
    export PATH=$PATH:$SQOOP_HOME/bin

# 3、配置sqoop-env.sh #

进入/home/hadoop/app/sqoop/sqoop-1.4.5/conf目录，修改配置文件：

#Set path to where bin/hadoop is available
    export HADOOP_COMMON_HOME=/home/hadoop/app/hadoop/hadoop-2.6.5
    
    #Set path to where hadoop-*-core.jar is available
    export HADOOP_MAPRED_HOME=/home/hadoop/app/hadoop/hadoop-2.6.5
    
    #set the path to where bin/hbase is available
    export HBASE_HOME=/home/hadoop/app/hbase/hbase-0.98.10-hadoop2
    
    #Set the path to where bin/hive is available
    #export HIVE_HOME=
    
    #Set the path for where zookeper config dir is
    export ZOOCFGDIR=/home/hadoop/app/zookeeper/zookeeper-3.4.6

# 4、复制mysql的驱动程序mysql-connector-java-5.0.8-bin.jar到/home/hadoop/app/sqoop/sqoop-1.4.5/lib目录 #

# 5、使用sqoop查看MySQL中的数据表 #

sqoop  list-databases  --connect jdbc:mysql://192.168.129.13:3306 --username root --password 123456

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2ZlbmdodWliaWFu_size_16_color_FFFFFF_t_70]

# 6、使用sqoop导出数据到hdfs #

sqoop import -m 1 -driver com.mysql.jdbc.Driver --connect jdbc:mysql://192.168.129.13:3306/test --username root --password 123456 --table user_info  --target-dir /sqoop/data

[Link 1]: http://mirror.bit.edu.cn/apache/sqoop/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2ZlbmdodWliaWFu_size_16_color_FFFFFF_t_70]: /images/20230601/6c0d41430cbe45a1aaf5165eeefb02c6.png