部署 Hyperledger Cello 文档

骑猪看日落 2022-05-27 14:09 249阅读 0赞

## 概述 ##

**Hyperledger Cello是Hyperledger下的一个子项目，其主要功能如下:**

1. 管理区块链的生命周期，例如自动创建/启动/停止/删除/保持健康状态。
     2. 支持定制（例如，大小，一致）区块链请求，目前主要支持Hyperledger架构。
     3. 支持裸机，虚拟机，本地Docker主机，群集或Kubernetes作为工作节点。 更多的支持途中。
     4. 支持异构体系结构，例如X86，POWER和Z，从裸机服务器到虚拟机云。
     5. 通过采用附加组件，扩展监控，日志，运行状况和分析功能。

架构图  
![arch][]

概览图

![block09][]  
**开发者利用Hyperledger Cello可以做到：**

1. 快速构建区块链即服务（BaaS）平台。
         2. 立即提供可定制的区块链，例如Hyperledger结构网络v1.0。
         3. 在裸机，虚拟云（例如，虚拟机，云数据云），容器集群（例如，Docker，Swarm，Kubernetes）之上维持一个运行区块链网络池。
         4. 通过仪表板检查系统状态，调整连锁数量，扩展资源......

**安装系统环境**

[root@hyperledger-cello-master cello]# cat /etc/redhat-release 
    CentOS Linux release 7.4.1708 (Core)

## 安装过程 ##

**系统要求**  
无论是master节点还是node节点系统要求都是一样的

Hardware: 8c16g100g
    Docker engine: 1.10.0~1.13.0 (Docker 17.0+ support is experimental)
    docker-compose: 1.8.0~1.12.0

**安装Master Node**

安装`git docker docker-compose` 安装docker-compose时需要安装`epel-release`源

yum install git docker -y
    yum install python-pip -y
    pip install --upgrade pip
    pip install docker-compose

启动docker

systemctl enable docker
    systemctl start docker systemctl status docker

获取源码

git clone http://gerrit.hyperledger.org/r/cello && cd cello

**安装**  
第一次安装官方建议执行`setup.sh`脚本，以后就可以执行`make setup-master`启动

cd cello/scripts/master_node/
    sh setup.sh

如果前面没有安装docker docker-compose等，将会安装

sudo yum install -y epel-release yum-utils
                sudo yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo
                sudo yum makecache fast
                sudo yum update && sudo yum install -y docker-ce python-pip
                sudo systemctl enable docker
                sudo systemctl start docker

出现以下日志表明安装成功

All Image downloaded 
    Checking local mounted database path /opt/cello/mongo...
    Local database path /opt/cello/mongo not existed, creating one
    Setup done, please logout and login again.
    It's safe to run this script repeatedly.

这个过程将会下载相关的镜像

[root@hyperledger-cello-master cello]# docker images 
    REPOSITORY                                       TAG                 IMAGE ID            CREATED             SIZE
    docker.io/hyperledger/cello-user-dashboard       x86_64-latest       386b4a865636        2 hours ago         1.11 GB
    hyperledger/cello-user-dashboard                 latest              386b4a865636        2 hours ago         1.11 GB
    docker.io/hyperledger/cello-operator-dashboard   x86_64-latest       37ad6c1e0473        2 hours ago         801 MB
    hyperledger/cello-operator-dashboard             latest              37ad6c1e0473        2 hours ago         801 MB
    docker.io/hyperledger/cello-mongo                x86_64-latest       99dec591054c        2 hours ago         801 MB
    hyperledger/cello-mongo                          latest              99dec591054c        2 hours ago         801 MB
    docker.io/hyperledger/cello-watchdog             x86_64-latest       54bf90282d88        2 hours ago         801 MB
    hyperledger/cello-watchdog                       latest              54bf90282d88        2 hours ago         801 MB
    docker.io/hyperledger/cello-engine               x86_64-latest       9e4c12d4ad08        2 hours ago         801 MB
    hyperledger/cello-engine                         latest              9e4c12d4ad08        2 hours ago         801 MB
    docker.io/hyperledger/cello-nginx                x86_64-latest       b8685f4c840c        2 hours ago         801 MB
    hyperledger/cello-nginx                          latest              b8685f4c840c        2 hours ago         801 MB
    docker.io/hyperledger/cello-baseimage            x86_64-latest       7ad34aad1efc        2 hours ago         801 MB
    hyperledger/cello-baseimage                      latest              7ad34aad1efc        2 hours ago         801 MB
    docker.io/node                                   9.2                 cb4c45f7a9e3        4 months ago        676 MB

通过`make logs` 查看日志 通过`make log service=watchdog`指定看哪个服务的日志

docker-compose logs -f --tail=200
    WARNING: The WEBROOT variable is not set. Defaulting to a blank string.
    WARNING: The STATIC_FOLDER variable is not set. Defaulting to a blank string. WARNING: The TEMPLATE_FOLDER variable is not set. Defaulting to a blank string.
    WARNING: Some services (mongo) use the 'deploy' key, which will be ignored. Compose does not support 'deploy' configuration - use `docker stack deploy` to deploy to a swarm.
    Attaching to

启动服务

make start //或者直接DEV=True make start(这个是dev模式启动master)目前测试的时候普通用户登陆是有问题的

启动了的容器

[root@hyperledger-cello-master cello]# docker ps 
    CONTAINER ID        IMAGE                                  COMMAND                  CREATED             STATUS              PORTS                                        NAMES
    ee830fc35423        hyperledger/cello-user-dashboard       "bash -c 'cd /usr/..."   3 seconds ago       Up 2 seconds        0.0.0.0:8081->8080/tcp                       cello-user-dashboard
    0fe6f30624b3        hyperledger/cello-watchdog             "python watchdog.py"     4 seconds ago       Up 3 seconds                                                     cello-watchdog
    d081ef0bbcfd        hyperledger/cello-mongo                "docker-entrypoint..."   4 seconds ago       Up 3 seconds        27017/tcp                                    cello_dashboard_mongo_1
    6d6965cc0a8b        hyperledger/cello-nginx                "/bin/bash /tmp/do..."   4 seconds ago       Up 3 seconds        0.0.0.0:80->80/tcp, 0.0.0.0:8080->8080/tcp   cello-nginx
    28349b09a597        hyperledger/cello-operator-dashboard   "/bin/sh -c 'if [ ..."   4 seconds ago       Up 3 seconds        8080/tcp                                     cello-operator-dashboard
    2e2cc63dfbbd        hyperledger/cello-engine               "python restserver.py"   4 seconds ago       Up 3 seconds        80/tcp                                       cello-engine
    600d26e414a6        hyperledger/cello-mongo                "docker-entrypoint..."   4 seconds ago       Up 3 seconds        127.0.0.1:27017-27018->27017-27018/tcp       cello-mongo

启动成功后默认的数据存储目录就是`/opt/cello/mongo`  
默认使用的配置文件`config.py`，可以通过这个环境变量`CELLO_CONFIG_FILE`修改  
访问`ip:8080`  
例如  
[http://10.39.43.84:8080/login][http_10.39.43.84_8080_login]

查看启动的端口

root@hyperledger-cello-master cello]# netstat -tlnp
    Active Internet connections (only servers)
    Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
    tcp        0      0 127.0.0.1:27017         0.0.0.0:*               LISTEN      13043/docker-proxy- 
    tcp        0      0 127.0.0.1:27018         0.0.0.0:*               LISTEN      13026/docker-proxy- 
    tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      4880/sshd           
    tcp6       0      0 :::80                   :::*                    LISTEN      13070/docker-proxy- 
    tcp6       0      0 :::8080                 :::*                    LISTEN      13057/docker-proxy- 
    tcp6       0      0 :::8081                 :::*                    LISTEN      13622/docker-proxy- 
    tcp6       0      0 :::22                   :::*                    LISTEN      4880/sshd

![block01][]

安装master节点成功

可以通过`make restart`重启服务以及`make stop`停止服务

也可以一个一个起服务  
例如

make redeploy service=dashboard

**安装Worker Node**  
安装worker node主要是安装docker-compose docker git 工具  
以及修改docker启动参数，让docker启动时监听`2375端口`，执行`make setup-worker`之后通过`http://10.39.43.84:8080/login`这个添加就可以

[root@hyperledger-cello-node cello]# cat /lib/systemd/system/docker.service 
    [Unit]
    Description=Docker Application Container Engine
    Documentation=http://docs.docker.com
    After=network.target rhel-push-plugin.socket registries.service
    Wants=docker-storage-setup.service
    Requires=docker-cleanup.timer
    
    [Service]
    Type=notify
    NotifyAccess=all
    EnvironmentFile=-/run/containers/registries.conf
    EnvironmentFile=-/etc/sysconfig/docker
    EnvironmentFile=-/etc/sysconfig/docker-storage
    EnvironmentFile=-/etc/sysconfig/docker-network
    Environment=GOTRACEBACK=crash
    Environment=DOCKER_HTTP_HOST_COMPAT=1
    Environment=PATH=/usr/libexec/docker:/usr/bin:/usr/sbin
    ExecStart=/usr/bin/dockerd-current \
              --add-runtime docker-runc=/usr/libexec/docker/docker-runc-current \
              --default-runtime=docker-runc \
              --exec-opt native.cgroupdriver=systemd \
              --userland-proxy-path=/usr/libexec/docker/docker-proxy-current \
              --seccomp-profile=/etc/docker/seccomp.json \
              --host=tcp://0.0.0.0:2375 \     --监听2375
              --host=unix:///var/run/docker.sock \ 
              $OPTIONS \
              $DOCKER_STORAGE_OPTIONS \
              $DOCKER_NETWORK_OPTIONS \
              $ADD_REGISTRY \
              $BLOCK_REGISTRY \
              $INSECURE_REGISTRY \
          $REGISTRIES
    ExecReload=/bin/kill -s HUP $MAINPID
    LimitNOFILE=1048576
    LimitNPROC=1048576
    LimitCORE=infinity
    TimeoutStartSec=0
    Restart=on-abnormal
    MountFlags=slave
    KillMode=process
    
    [Install]
    WantedBy=multi-user.target

或者执行

sudo systemctl stop docker.service
    $ sudo dockerd -H tcp://0.0.0.0:2375 -H unix:///var/run/docker.sock --api-cors-header='*' --default-ulimit=nofile=8192:16384 --default-ulimit=nproc=8192:16384 -D &

这个命令将会docker被重启之后才改变

在master节点上验证是否可以访问worker node 节点的docker监听的端口`:2375`端口

[root@hyperledger-cello-node cello]# netstat -tlnp
    Active Internet connections (only servers)
    Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
    tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      4896/sshd           
    tcp6       0      0 :::22                   :::*                    LISTEN      4896/sshd           
    tcp6       0      0 :::2375                 :::*                    LISTEN      14127/dockerd-curre

docker -H Worker_Node_IP:2375 info
    例如:
    docker -H 10.39.43.84:2375 info
    Containers: 0
     Running: 0
     Paused: 0
     Stopped: 0
    Images: 0
    Server Version: 1.13.1
    ...

在worker node 节点上执行

make setup-worker
     sysctl -w net.ipv4.ip_forward=1 //如果不执行这个也没有关系

执行成功将会看到以下信息

Status: Downloaded newer image for docker.io/hyperledger/fabric-zookeeper:x86_64-1.0.4
    Done, now worker node should have all required images, use 'docker images' to check
    Copy required fabric 1.0 artifacts
    Checking local artifacts path /opt/cello...
    Local artifacts path /opt/cello not existed, creating one
    Setup ip forward rules
    net.ipv4.ip_forward = 1
    Setup done

同样也会拉取镜像，镜像list为

[root@hyperledger-cello-node cello]# docker images 
    REPOSITORY                               TAG                 IMAGE ID            CREATED             SIZE
    docker.io/mysql                          5.7                 5195076672a7        5 weeks ago         371 MB
    docker.io/yeasy/blockchain-explorer      0.1.0-preview       d3d781c8c96b        3 months ago        659 MB
    docker.io/hyperledger/fabric-tools       x86_64-1.0.5        6a8993b718c8        4 months ago        1.33 GB
    hyperledger/fabric-tools                 1.0.5               6a8993b718c8        4 months ago        1.33 GB
    docker.io/hyperledger/fabric-orderer     x86_64-1.0.5        368c78b6f03b        4 months ago        151 MB
    hyperledger/fabric-orderer               1.0.5               368c78b6f03b        4 months ago        151 MB
    docker.io/hyperledger/fabric-peer        x86_64-1.0.5        c2ab022f0bdb        4 months ago        154 MB
    hyperledger/fabric-peer                  1.0.5               c2ab022f0bdb        4 months ago        154 MB
    docker.io/hyperledger/fabric-ccenv       x86_64-1.0.5        33feadb8f7a6        4 months ago        1.28 GB
    docker.io/hyperledger/fabric-ca          x86_64-1.0.5        002c9089e464        4 months ago        238 MB
    hyperledger/fabric-ca                    1.0.5               002c9089e464        4 months ago        238 MB
    docker.io/hyperledger/fabric-kafka       x86_64-1.0.4        7a9d6f3c4a7c        5 months ago        1.29 GB
    hyperledger/fabric-kafka                 1.0.5               7a9d6f3c4a7c        5 months ago        1.29 GB
    docker.io/hyperledger/fabric-zookeeper   x86_64-1.0.4        53c4a0d95fd4        5 months ago        1.3 GB
    hyperledger/fabric-zookeeper             1.0.5               53c4a0d95fd4        5 months ago        1.3 GB
    docker.io/hyperledger/fabric-baseimage   x86_64-0.3.2        c92d9fdee998        7 months ago        1.26 GB
    docker.io/hyperledger/fabric-baseos      x86_64-0.3.2        bbcbb9da2d83        7 months ago        129 MB

通过`http://10.39.43.84:8080/login`添加节点  
请参考[tutorial][]  
如果没有创建Chains则没有起任何容器  
在页面添加Chains 就会在node节点上执行起以下容器

[root@hyperledger-cello-node cello]# docker ps 
    CONTAINER ID        IMAGE                                     COMMAND                  CREATED             STATUS              PORTS                                            NAMES
    0717e516142f        yeasy/blockchain-explorer:0.1.0-preview   "bash -c 'sleep 30..."   2 minutes ago       Up 2 minutes        0.0.0.0:8150->8080/tcp                           54b88e7d607d4fb49e79cd29ab3cba78_explorer
    e5b43d173eeb        hyperledger/fabric-tools:1.0.5            "bash -c 'sleep 15..."   2 minutes ago       Up 2 minutes                                                         54b88e7d607d4fb49e79cd29ab3cba78_cli
    6e18ce116af9        hyperledger/fabric-peer:1.0.5             "peer node start"        2 minutes ago       Up 2 minutes        0.0.0.0:7150->7051/tcp, 0.0.0.0:7050->7053/tcp   54b88e7d607d4fb49e79cd29ab3cba78_peer0_org1
    c4f692139b45        hyperledger/fabric-peer:1.0.5             "peer node start"        2 minutes ago       Up 2 minutes        0.0.0.0:7350->7051/tcp, 0.0.0.0:7250->7053/tcp   54b88e7d607d4fb49e79cd29ab3cba78_peer1_org1
    9c2b8910b09a        hyperledger/fabric-peer:1.0.5             "peer node start"        2 minutes ago       Up 2 minutes        0.0.0.0:7550->7051/tcp, 0.0.0.0:7450->7053/tcp   54b88e7d607d4fb49e79cd29ab3cba78_peer0_org2
    4cfc92c65273        hyperledger/fabric-peer:1.0.5             "peer node start"        2 minutes ago       Up 2 minutes        0.0.0.0:7750->7051/tcp, 0.0.0.0:7650->7053/tcp   54b88e7d607d4fb49e79cd29ab3cba78_peer1_org2
    88a1021c8b9e        hyperledger/fabric-orderer:1.0.5          "orderer"                2 minutes ago       Up 2 minutes        0.0.0.0:8050->7050/tcp                           54b88e7d607d4fb49e79cd29ab3cba78_orderer
    0e542c318f18        mysql:5.7                                 "docker-entrypoint..."   2 minutes ago       Up 2 minutes        3306/tcp                                         54b88e7d607d4fb49e79cd29ab3cba78_mysql
    6b428bd5783a        hyperledger/fabric-ca:1.0.5               "sh -c 'fabric-ca-..."   2 minutes ago       Up 2 minutes        0.0.0.0:7950->7054/tcp                           54b88e7d607d4fb49e79cd29ab3cba78_ca_org2
    84e6aad97c83        hyperledger/fabric-ca:1.0.5               "sh -c 'fabric-ca-..."   2 minutes ago       Up 2 minutes        0.0.0.0:7850->7054/tcp                           54b88e7d607d4fb49e79cd29ab3cba78_ca_org1

在worker node 上创建chain后，在页面可以看到  
![block08][]

chain的信息  
![block07][]

通过`10.39.43.101:8150`访问Hyperledger Explorer  
![block05][]

普通用户登录的路径`http://master_ip:8081`  
例如

http://10.39.43.84:8081

![block00][]

![user][]

安装完毕，还有更多功能，请自行摸索  
参考：  
[Hyperledger Cello][]  
[installation][]  
[tutorial][]  
[setup][]  
[dashboard][]

[arch]: /images/20220527/aedd844630dd4132839352c0856fb45b.png
[block09]: /images/20220527/dc4b94fdc298429f8025c0d780db24f4.png
[http_10.39.43.84_8080_login]: http://10.39.43.84:8080/login
[block01]: /images/20220527/5c63e53f711c44048a19678e81a55a4c.png
[tutorial]: http://cello.readthedocs.io/en/latest/tutorial/
[block08]: /images/20220527/5446cd2858cf495295c0a80fb905b611.png
[block07]: /images/20220527/eec73ccf51644285bda645d84962abdc.png
[block05]: /images/20220527/72352dc6736448599ef2ffe93ea52bc0.png
[block00]: /images/20220527/6af99c2360ee468b999ff2ba3640f554.png
[user]: /images/20220527/80b1addff04b430184de898e8636b3ee.png
[Hyperledger Cello]: http://cello.readthedocs.io/en/latest/
[installation]: http://hyperledger-cello.readthedocs.io/en/latest/installation/
[setup]: http://cello.readthedocs.io/en/latest/setup/
[dashboard]: http://hyperledger-cello.readthedocs.io/en/latest/dashboard/