hadoop集群，如何运行Java jar包---如何运行mapreduce程序

心已赠人 2022-07-26 08:41 558阅读 0赞

<table style="word-wrap:break-word; empty-cells:show; border-collapse:collapse; table-layout:fixed; width:757px; color:rgb(68,68,68); font-family:Tahoma,'Microsoft Yahei',Simsun; font-size:12px; line-height:18px"> 
 <tbody style="word-wrap:break-word"> 
  <tr style="word-wrap:break-word"> 
   <td style="word-wrap:break-word; font-size:14px"> http://www.aboutyun.com/thread-7408-1-1.html<br style="word-wrap:break-word"> <br style="word-wrap:break-word"> hadoop集群运行mapreduce有两种方式：1.一种是打包，在hadoop集群运行<br style="word-wrap:break-word"> 2.一种是开发环境运行。<br style="word-wrap:break-word"> 下面详细讲一下：<br style="word-wrap:break-word"> <span style="word-wrap:break-word; font-weight:700">1.一种是打包，在hadoop集群运行</span><br style="word-wrap:break-word"> 首先我们要打包程序，打包具体可以参考<br style="word-wrap:break-word"> （hadoop编程：解决eclipse能运行，打包放到集群上ClassNotFoundException:经验总结）<br style="word-wrap:break-word"> <a href="http://www.aboutyun.com/thread-7086-1-1.html" style="word-wrap:break-word; color:rgb(51,102,153)" rel="nofollow">http://www.aboutyun.com/thread-7086-1-1.html</a><br style="word-wrap:break-word"> <span style="word-wrap:break-word; font-weight:700">，打包完毕，我们该如何运行</span><br style="word-wrap:break-word"> <span style="word-wrap:break-word; font-weight:700">首先显示一个比较简单的：</span><br style="word-wrap:break-word"> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word"><span style="color:#333333; word-wrap:break-word"><img alt="" src="http://www.aboutyun.com/data/attachment/album/201404/16/140327ldgcaidkgwwdygph.png" width="528" height="86" style="word-wrap:break-word"></span></span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">上面命令：hadoop jar x.jar 是运行包的一种方式，完成的方式为</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">hadoop jar&nbsp;&nbsp;x.jar&nbsp;&nbsp;×××.MainClassName inputPath outputPath</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">同时解释一下：</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">x.jar为包的名称，包括路径，直接写包名称，则为默认路径</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">×××.MainClassName为运行的类名称</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">inputPath为输入路径</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word">outputPath为输出路径。</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word">这里需要注意的是：</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word">输入路径和输出路径，一定要对应。</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word">比如</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word">输入路径</span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word"></span> 
     <div style="word-wrap:break-word; overflow:hidden; margin:10px 0px; padding:10px 0px 5px 10px; color:rgb(102,102,102); zoom:1; border:1px solid rgb(204,204,204)"> 
      <div style="word-wrap:break-word"> 
       <ol style="word-wrap:break-word; margin:0px 0px 0px 10px!important; padding:0px!important"> 
        <li style="word-wrap:break-word; margin:0px 0px 0px 2em; padding:0px 0px 0px 10px; list-style-type:decimal-leading-zero; font-family:Monaco,Consolas,'Lucida Console','Courier New',serif; font-size:12px; line-height:1.8em"> hdfs://192.168.1.100:9000/user/hadoop/filetest/word.txt&nbsp;<br style="word-wrap:break-word"> </li> 
        <li style="word-wrap:break-word; margin:0px 0px 0px 2em; padding:0px 0px 0px 10px; list-style-type:decimal-leading-zero; font-family:Monaco,Consolas,'Lucida Console','Courier New',serif; font-size:12px; line-height:1.8em"> </li> 
       </ol> 
      </div> 
      <span style="word-wrap:break-word; margin-left:43px; font-size:12px; color:rgb(51,102,153)!important">复制代码</span> 
     </div> 
     <br style="word-wrap:break-word"> 输出路径： 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word"></span> 
     <div style="word-wrap:break-word; overflow:hidden; margin:10px 0px; padding:10px 0px 5px 10px; color:rgb(102,102,102); zoom:1; border:1px solid rgb(204,204,204)"> 
      <div style="word-wrap:break-word"> 
       <ol style="word-wrap:break-word; margin:0px 0px 0px 10px!important; padding:0px!important"> 
        <li style="word-wrap:break-word; margin:0px 0px 0px 2em; padding:0px 0px 0px 10px; list-style-type:decimal-leading-zero; font-family:Monaco,Consolas,'Lucida Console','Courier New',serif; font-size:12px; line-height:1.8em"> hdfs://192.168.1.100:9000/user/hadoop/output</li> 
       </ol> 
      </div> 
      <span style="word-wrap:break-word; margin-left:43px; font-size:12px; color:rgb(51,102,153)!important">复制代码</span> 
     </div> 
     <br style="word-wrap:break-word"> 二者就不一致，output后面需要加入文件名，二者对应起来。 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000000; word-wrap:break-word"><br style="word-wrap:break-word"> </span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word"><span style="word-wrap:break-word; font-weight:700">2.mapreduce在eclipse中运行</span></span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word"><span style="word-wrap:break-word; font-weight:700">对于下面按照步骤单击Java Application就ok了。</span></span> 
    </div> 
    <div style="word-wrap:break-word"> 
     <span style="color:#000; word-wrap:break-word"><span style="color:#333333; word-wrap:break-word"><img alt="" src="http://www.aboutyun.com/data/attachment/album/201404/16/141830cu6d37596rwe4m7z.png" width="600" height="311" style="word-wrap:break-word"></span></span> 
    </div> </td> 
  </tr> 
 </tbody> 
</table>