OpenTSDB安装与使用

迈不过友情╰ 2021-06-24 14:36 451阅读 0赞

## 1. 安装环境 ##

### 1. 系统版本 ###

('centos', '6.4', 'Final')

### 2. 内核版本 ###

Linux localhost.localdomain 2.6.32-358.el6.x86\_64 \#1 SMP Fri Feb 22 00:31:26 UTC 2013 x86\_64 x86\_64 x86\_64 GNU/Linux

### 3. 依赖安装 ###

#### 1. java安装 ####

1.yum install java-1.6.0-openjdk-devel.x86\_64

2. java环境变量设置

在~/.bash\_profile文件中添加以下行。

\# java  
export JAVA\_HOME=/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86\_64/  
export PATH=$JAVA\_HOME/bin:$PATH  
export CLASSPATH=.:$JAVA\_HOME/lib/dt.jar:$JAVA\_HOME/lib/tools.jar

#### 2 gnuplot安装 ####

yum install libotf

yum install gnuplot-common.x86\_64

yum install gnuplot.x86\_64

## 2. hbase 安装 ##

### 1.  源码下载 ###

wget [http://mirror.bit.edu.cn/apache/hbase/hbase-0.94.27/hbase-0.94.27.tar.gz][http_mirror.bit.edu.cn_apache_hbase_hbase-0.94.27_hbase-0.94.27.tar.gz]

### 2. 配置修改 ###

1.修改hbase-env.sh中的如下属性

export JAVA\_HOME=/usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0.x86\_64/

export HBASE\_MANAGES\_ZK=true

2.单机配置修改hbase-site.xml：

<name>hbase.rootdir</name>

<value>/root/guochunyang/hbase\_fs/</value>

</property>

</configuration>

### 3. 启动hbase ###

./bin/start-hbase.sh

4. 关闭hbase

./bin/stop-hbase.sh

## 3. opentsdb 安装 ##

### 1. 下载源码 ###

git clone [https://github.com/OpenTSDB/opentsdb.git][https_github.com_OpenTSDB_opentsdb.git]

### 2.编译 ###

./build.sh

### 3. 建表 ###

env COMPRESSION=NONE HBASE\_HOME=../hbase-0.94.27 src/create\_table.sh

#### 4. 配置文件 opentsdb.conf ####

\[[root@10.77.51.10][root_10.77.51.10] opentsdb\]\# cat /etc/opentsdb.conf   
\# --------- NETWORK ----------  
\# The TCP port TSD should use for communications  
\# \*\*\* REQUIRED \*\*\*  
tsd.network.port = 4242  
  
\# The IPv4 network address to bind to, defaults to all addresses  
\# tsd.network.bind = 0.0.0.0  
  
\# Enables Nagel's algorithm to reduce the number of packets sent over the  
\# network, default is True  
\#tsd.network.tcpnodelay = true  
  
\# Determines whether or not to send keepalive packets to peers, default   
\# is True  
\#tsd.network.keepalive = true  
  
\# Determines if the same socket should be used for new connections, default   
\# is True  
\#tsd.network.reuseaddress = true  
  
\# Number of worker threads dedicated to Netty, defaults to \# of CPUs \* 2  
\#tsd.network.worker\_threads = 8  
  
\# Whether or not to use NIO or tradditional blocking IO, defaults to True  
\#tsd.network.async\_io = true  
  
\# ----------- HTTP -----------  
\# The location of static files for the HTTP GUI interface.  
\# \*\*\* REQUIRED \*\*\*  
tsd.http.staticroot = build/staticroot  
  
\# Where TSD should write it's cache files to  
\# \*\*\* REQUIRED \*\*\*  
tsd.http.cachedir = /tmp/tsd  
  
\# --------- CORE ----------  
\# Whether or not to automatically create UIDs for new metric types, default  
\# is False  
\#tsd.core.auto\_create\_metrics = false  
tsd.core.auto\_create\_metrics = true  
  
\# --------- STORAGE ----------  
\# Whether or not to enable data compaction in HBase, default is True  
\#tsd.storage.enable\_compaction = true  
  
\# How often, in milliseconds, to flush the data point queue to storage,   
\# default is 1,000  
\# tsd.storage.flush\_interval = 1000  
  
\# Name of the HBase table where data points are stored, default is "tsdb"  
\#tsd.storage.hbase.data\_table = tsdb  
  
\# Name of the HBase table where UID information is stored, default is "tsdb-uid"  
\#tsd.storage.hbase.uid\_table = tsdb-uid  
  
\# Path under which the znode for the -ROOT- region is located, default is "/hbase"  
\#tsd.storage.hbase.zk\_basedir = /hbase  
  
\# A comma separated list of Zookeeper hosts to connect to, with or without   
\# port specifiers, default is "localhost"  
\#tsd.storage.hbase.zk\_quorum = localhost

### 5.启动 ###

带参数模式

./build/tsdb tsd --port=4242 --staticroot=build/staticroot --cachedir="$tsdtmp" --zkquorum=127.0.0.1:2181

使用配置文件

./build/tsdb tsd

### 6. 创建指标 ###

1. 手动创建指标

\[[root@10.77.51.10][root_10.77.51.10] opentsdb\]\# ./build/tsdb mkmetric mysql.bytes\_received mysql.bytes\_sent  
metrics mysql.bytes\_received: \[0, 0, 1\]  
metrics mysql.bytes\_sent: \[0, 0, 2\]

2.自动创建指标

需要修改配置文件中tsd.core.auto\_create\_metrics = true,默认为false。

需要向tsdb的监听端口发送消息。比如：

put tsd.connectionmgr.connections 1443170747 6 type=open host=localhost.localdomain

3.向OpenTSDB添加数据

(1)telnet或者nc

语法：

put <metric> <timestamp> <value> <tagk1=tagv1\[ tagk2=tagv2 ...tagkN=tagvN\]>

例如:

put sys.cpu.user 1356998400 42.5 host=webserver01 cpu=0

\[root@10.77.51.10 ~\]\# telnet 127.0.0.1 4242

Trying 127.0.0.1...

Connected to 127.0.0.1.

Escape character is '^\]'.

put proc.test.telnet 1443426262 12 telnet\_host=localhost

\[root@10.77.51.10 ~\]\# nc 127.0.0.1 4242

put proc.test.nc 1443426262 3 nc\_host=localhost

(2)HTTP API

curl -H "Content-Type: application/json" -X POST  [http://127.0.0.1:4242/api/put/][http_127.0.0.1_4242_api_put] -d '\{"metic":"proc.test.curlpost","timestamp":1443427323,"value":18,"tags":\{"host":"web01","dc":"lga"\}\}'

或者通过以下python脚本

[root@10.77.51.10 opentsdb_test]# cat test_post.py 
    #!/usr/bin/env python
    #  -*- coding:utf-8 -*-
    
    import httplib
    import urllib
    import urllib2
    import json
    import time
    import random
    
    def my_post():
        base_url = '10.77.51.10'
        headerdata =  {'Content-type':'application/json'}
        time_cur = int(time.time())
        va = random.randint(1,100)
        values = {
            "metric": "proc.test.httppost",
            "timestamp": time_cur,
            "value": va,
            "tags": {
               "host": "web01",
               "dc": "lga"
            }
        }
        jdata = json.dumps(values)
        conn = httplib.HTTPConnection(base_url,4242)
        conn.request(method="POST",url="/api/put/",body=jdata,headers=headerdata)
        res = conn.getresponse()
        res.read()
        # get response /api/put?details
        conn.request(method="POST",url="/api/put?details",body=jdata,headers=headerdata)
        res = conn.getresponse()
        return res.read()
    
    while(True):
        try:
            resp = my_post()
            print(resp)
            time.sleep(1)
        except Exception as e:
            exit(0)
        except KeyboardInterrupt as e:
            exit(0)
    [root@10.77.51.10 opentsdb_test]# python test_post.py 
    {"errors":[],"failed":0,"success":1}
    {"errors":[],"failed":0,"success":1}
    {"errors":[],"failed":0,"success":1}
    {"errors":[],"failed":0,"success":1}
    ^C[root@10.77.51.10 opentsdb_test]#

参考[http://opentsdb.net/docs/build/html/api\_http/put.html][http_opentsdb.net_docs_build_html_api_http_put.html]

(3)批量导入

参考[http://opentsdb.net/docs/build/html/user\_guide/cli/import.html][http_opentsdb.net_docs_build_html_user_guide_cli_import.html]

## 3. tcollector安装 ##

1. 下载源码

[https://github.com/OpenTSDB/tcollector][https_github.com_OpenTSDB_tcollector]

2. 启动

\[root@10.77.51.10 tcollector\]\# pwd

/root/guochunyang/tcollector

\[root@10.77.51.10 tcollector\]\# python tcollector.py

## 4. opentsdb\_test ##

1. 启动opentsdb,配置支持tsd.core.auto\_create\_metrics = true,启动hbase,启动tcollector。用浏览器打开,打开后如图

2. 测试

Metric:test1.test1.test1

测试程序：

\[root@10.77.51.10 opentsdb\_test\]\# cat test2.py

import subprocess

import time

import logging

import random

logging.basicConfig(level=logging.DEBUG,filename="test.log")

def put\_data(metric,value,\*\*kw):

t = int(time.time())

cmd = "echo put %s %d %d host=test1 tag\_k1=tag\_v1 | nc -w 30 127.0.0.1 4242" %(metric,t,value)

subp = subprocess.Popen(cmd,shell=True,stdout=subprocess.PIPE)

random.seed()

while(True):

i = random.randint(1,100)

time.sleep(1)

put\_data("test1.test1.test1",i)

i += 1

监控结果如图：

[http_mirror.bit.edu.cn_apache_hbase_hbase-0.94.27_hbase-0.94.27.tar.gz]: http://mirror.bit.edu.cn/apache/hbase/hbase-0.94.27/hbase-0.94.27.tar.gz
[https_github.com_OpenTSDB_opentsdb.git]: https://github.com/OpenTSDB/opentsdb.git
[root_10.77.51.10]: mailto:root@10.77.51.10
[http_127.0.0.1_4242_api_put]: http://127.0.0.1:4242/
[http_opentsdb.net_docs_build_html_api_http_put.html]: http://opentsdb.net/docs/build/html/api_http/put.html
[http_opentsdb.net_docs_build_html_user_guide_cli_import.html]: http://opentsdb.net/docs/build/html/user_guide/cli/import.html
[https_github.com_OpenTSDB_tcollector]: https://github.com/OpenTSDB/tcollector