StreamSets 下载安装教程

我会带着你远行 2022-05-17 08:18 1486阅读 0赞

本教程以 StreamSet 3.4.0 为例

StreamSet有多种安装方式，最简单的一种就是下载压缩包，直接解压即可使用

**1、下载StringSet压缩包**

*  StringSet下载地址：[https://streamsets.com/opensource/][https_streamsets.com_opensource]

![70][]

*  执行以下语句

$ tar xvzf streamsets-datacollector-core-3.4.0.tgz

**2、运行StreamSet**

*  切换到解压到目录下，执行：

$ streamsets-datacollector-3.4.0/bin/streamset dc

![70 1][]

*  本地浏览器打开：http://localhost:18630/ 默认端口为18630
 *  登录，默认的用户名和密码均为admin

**注：启动的时候可能会报open file limit 的问题，解决办法如下**：

*  *Mac系统：*

$ sudo vim /Library/LaunchDaemons/limit.maxfiles.plist

然后添加如下内容，并重启即可

<?xml version="1.0" encoding="UTF-8"?>
 <!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
 <plist version="1.0">
 <dict>
 <key>Label</key>
 <string>limit.maxfiles</string>
 <key>ProgramArguments</key>
 <array>
 <string>launchctl</string>
 <string>limit</string>
 <string>maxfiles</string>
 <string>65536</string>
 <string>65536</string>
 </array>
 <key>RunAtLoad</key>
 <true/>
 <key>ServiceIPC</key>
 <false/>
 </dict>
 </plist>

*  *Linux系统*

（1）暂时性修改，只对当前终端有效

$ ulimit -HSn 65536

（2）将ulimit -HSn 65536 写到/etc/profile中，因为每次登录终端时，都会自动执行/etc/profile

（3）永久生效

修改配置文件：/etc/security/limits.conf ，在文件后添加如下内容，并重启

* soft nofile 65536
    * hard nofile 65536

3、主界面介绍

*  登录界面

![70 2][]  
![70 3][]

*  主界面

![70 4][]

<table> 
 <tbody> 
 <tr> 
 <td style="width:112px;"> Number </td> 
 <td style="width:169px;"> Name </td> 
 <td style="width:660px;"> Description </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> 1 </td> 
 <td style="width:169px;"> Pipeline Creation Help Bar </td> 
 <td style="width:660px;"> Indicates that the origin is missing and offers a list of origins to choose from. If the Pipeline Creation Help Bar does not display, you might have disabled it. To enable it, in the top right corner of the&nbsp;Data Collector&nbsp;window, click the&nbsp;Help&nbsp;&gt;&nbsp;Settings. Clear the&nbsp;Hide Pipeline Creation Help Bar&nbsp;option. </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> 2 </td> 
 <td style="width:169px;"> Issues icon </td> 
 <td style="width:660px;"> Click to display the list of pipeline issues found by implicit validation. </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> 3 </td> 
 <td style="width:169px;"> Stage library panel </td> 
 <td style="width:660px;"> Displays a list of available origins by default. </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> 4 </td> 
 <td style="width:169px;"> Stage menu </td> 
 <td style="width:660px;"> Changes the stages that display in the stage library. Displays all stages by default. </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> 5 </td> 
 <td style="width:169px;"> Properties panel / Preview panel / Monitor panel </td> 
 <td style="width:660px;"> When you configure a pipeline, the Properties panel displays the properties of the pipeline or selected stage. You can resize, minimize and maximize the panel. When you preview data, the Preview panel displays the input and output data for the selected stage or group of stages. When you monitor a running pipeline, the Monitor panel displays real-time metrics and statistics. Note:&nbsp;Some icons and options might not display in the UI. The items that display are based on the task that you are performing and roles assigned to your user account. </td> 
 </tr> 
 <tr> 
 <td style="width:112px;"> <img alt="" height="22" src="https://img-blog.csdn.net/20180808225242554?watermark/2/text/aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L1lGX0xpMTIz/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70" width="25"> </td> 
 <td style="width:169px;"> Stage Library icon </td> 
 <td style="width:660px;"> Toggles the display of the Stage Library panel. </td> 
 </tr> 
 </tbody> 
</table>

参考:：

1： [https://streamsets.com/documentation/datacollector/latest/help/index.html\#datacollector/UserGuide/Installation/Installing\_the\_DC.html\#task\_bt1\_zcp\_kq][https_streamsets.com_documentation_datacollector_latest_help_index.html_datacollector_UserGuide_Installation_Installing_the_DC.html_task_bt1_zcp_kq]

2：[https://streamsets.com/opensource/][https_streamsets.com_opensource]

[https_streamsets.com_opensource]: https://streamsets.com/opensource/
[70]: /images/20220517/fe6fc377fbe041d8bce0f2c660630441.png
[70 1]: /images/20220517/ca3b372f88de49f2bcda2e7d5edb6bcb.png
[70 2]: /images/20220517/413f5bf9fdd44c71987c1bc3f0710580.png
[70 3]: /images/20220517/d451f9cadeac431c9ac00cceba4f65f1.png
[70 4]: /images/20220517/3633dc32fb6044d4b08d67ecd0a6b0cf.png
[https_streamsets.com_documentation_datacollector_latest_help_index.html_datacollector_UserGuide_Installation_Installing_the_DC.html_task_bt1_zcp_kq]: https://streamsets.com/documentation/datacollector/latest/help/index.html#datacollector/UserGuide/Installation/Installing_the_DC.html%23task_bt1_zcp_kq