自动机器学习框架nni的案例使用

爱被打了一巴掌 2022-10-30 14:24 156阅读 0赞

nni是微软开源出来的一个自动机器学习框架

可以使机器学习调参更加便利

安装非常简单，使用pip就行

pip install nni

本次使用的是最新的版本，2.0

不过此时并不能使用，因为会出现：

[https://github.com/microsoft/nni/issues/3276][https_github.com_microsoft_nni_issues_3276]

解决也很简单，直接将ruamel.yaml改成ruamel\_yaml

将下面路径下的内容进行编辑修改即可

vim /opt/AN/lib/python3.7/site-packages/nni/tools/nnictl/common_utils.py
    vim /opt/AN/lib/python3.7/site-packages/nni/experiment/config/base.py
    vim /opt/AN/lib/python3.7/site-packages/nni/tools/package_utils/__init__.py

然后就可以正常使用了

root@lizong:/opt# nnictl --help
    usage: nnictl [-h] [--version]
                  {ss_gen,create,resume,view,update,stop,trial,experiment,platform,webui,config,log,algo,package,tensorboard,top}
                  ...
    
    use nnictl command to control nni experiments
    
    positional arguments:
      {ss_gen,create,resume,view,update,stop,trial,experiment,platform,webui,config,log,algo,package,tensorboard,top}
        ss_gen              automatically generate search space file from trial
                            code
        create              create a new experiment
        resume              resume a new experiment
        view                view a stopped experiment
        update              update the experiment
        stop                stop the experiment
        trial               get trial information
        experiment          get experiment information
        platform            get platform information
        webui               get web ui information
        config              get config information
        log                 get log information
        algo                control nni builtin tuner, assessor and advisor
                            algorithms
        package             this argument is replaced by algo
        tensorboard         manage tensorboard
        top                 monitor the experiment
    
    optional arguments:
      -h, --help            show this help message and exit
      --version, -v

接下来运行一下官方提供的例子：

nnictl create --config nni/examples/trials/mnist-pytorch/config.yml

注意：运行之前需要git clone

git clone -b v2.0 https://github.com.cnpmjs.org/Microsoft/nni.git

运行成功后，可以在网页上观察运行结果：

具体访问地址------运行机器ip:8080

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70][]

我们可以看到，上图已经运行了48m54s了，最好的得分是99分

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 1][]

看一下超参数的曲线：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 2][]

运行介绍会出现：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 3][]

[https_github.com_microsoft_nni_issues_3276]: https://github.com/microsoft/nni/issues/3276
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70]: /images/20221024/8bd5f745137c459a89269d20743e12b3.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 1]: /images/20221024/aadd1d36645a46aeb9db9ff17f57c45c.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 2]: /images/20221024/605c65672a9b4e838ec28af17c381618.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3pob3VfNDM4_size_16_color_FFFFFF_t_70 3]: /images/20221024/d19efb2dc8d24733a498e8017e0de9af.png