Python 实用库记录

迷南。 2022-12-11 09:28 214阅读 0赞

Python 之所以火爆除了其本身的语法和特性之外，还在一定程度上取决于其有太多太多库的支持，不论是官方维护的还是第三方开发的。就比如说做机器学习为什么很多人都用 Python，一个非常大的因素就是 TensorFlow 和 PyTorch 对 Python 的支持。当然在这里并不是说 Python 的库真的就全的不要不要的，它在某些领域或者项目的生态还是有待完善的。

### attrs、cattrs ###

GitHub：[https://github.com/python-attrs/attrs、https://github.com/Tinche/cattrs][https_github.com_python-attrs_attrs_https_github.com_Tinche_cattrs]

简化类的定义、序列化反序列化等操作。

个人写的简介：[https://mp.weixin.qq.com/s/oHK-Y4lOeaQCFtDWgqXxFA][https_mp.weixin.qq.com_s_oHK-Y4lOeaQCFtDWgqXxFA]

### loguru ###

GitHub：[https://github.com/Delgan/loguru][https_github.com_Delgan_loguru]

可简化日志记录写法。

个人写的简介：[https://mp.weixin.qq.com/s/5Ri1WS5cTGCNAQ0I\_zYycg][https_mp.weixin.qq.com_s_5Ri1WS5cTGCNAQ0I_zYycg]

### autopep8 ###

GitHub：[https://github.com/hhatto/autopep8][https_github.com_hhatto_autopep8]

把 Python 代码转成符合 PEP8 规范的代码。

### psutil ###

GitHub：[https://github.com/giampaolo/psutil][https_github.com_giampaolo_psutil]

Python 实现任务监控的库。

### furl ###

GitHub：[https://github.com/gruns/furl][https_github.com_gruns_furl]

对 url 的处理非常方便，比 urllib 等库好用多。

### retrying、tenacity ###

GitHub：[https://github.com/rholder/retrying、https://github.com/jd/tenacity][https_github.com_rholder_retrying_https_github.com_jd_tenacity]

异常重试库，如出错之后重试多少次，尤其在发起一些 HTTP 请求时非常有用，当然也能用于其他地方。

### typing ###

Docs：[https://docs.python.org/zh-cn/3/library/typing.html\#module-typing][https_docs.python.org_zh-cn_3_library_typing.html_module-typing]

对 Python 类型的支持，支持多种类型、嵌套类型，也推荐多多使用 Python 的类型注解。

### argparse ###

Docs：[https://docs.python.org/zh-cn/3/library/argparse.html][https_docs.python.org_zh-cn_3_library_argparse.html]

个人曾经使用过几个命令行解析工具，如 docopt，但后来还是转回来了 argparse，功能齐全强大。

### absl-py ###

GitHub：[https://github.com/abseil/abseil-py][https_github.com_abseil_abseil-py]

个人感觉比 argparse 更易用的库，如 TensorFlow 就在使用这个，对于定义一些 Flag 非常方便。

### pipenv ###

GitHub：[https://github.com/pypa/pipenv][https_github.com_pypa_pipenv]

功能更全的包管理工具，集成虚拟环境、支持 Lock 机制锁定安装包版本和依赖信息。当然也有坑点，可自行搜索。

### drf ###

Docs：[https://www.django-rest-framework.org/][https_www.django-rest-framework.org]

基于 Django 的 REST Framework，快速实现 REST API。

### watchdog ###

GitHub：[https://github.com/gorakhargosh/watchdog][https_github.com_gorakhargosh_watchdog]

方便监视文件系统改动。

### glob ###

Docs：[https://docs.python.org/3/library/glob.html][https_docs.python.org_3_library_glob.html]

对文件的操作非常方便。

### 2to3 ###

Docs：[https://docs.python.org/2/library/2to3.html][https_docs.python.org_2_library_2to3.html]

把 Python2 代码转成 Python3 代码。

### glom ###

GitHub：[https://github.com/mahmoud/glom][https_github.com_mahmoud_glom]

对 JSON 嵌套的处理非常方便。

### pathlib ###

Docs：[https://docs.python.org/3/library/pathlib.html][https_docs.python.org_3_library_pathlib.html]

更为方便的 Python 路径操作库。

### environs ###

GitHub：[https://github.com/sloria/environs][https_github.com_sloria_environs]

对于环境变量的获取非常方便，支持多种类型，如 int、bool 等。

### pysnooper ###

GitHub：[https://github.com/cool-RR/PySnooper][https_github.com_cool-RR_PySnooper]

非常方便简单的 Python 调试器，可以追踪到代码每一处细节的执行状态。

### tqdm ###

GitHub：[https://github.com/tqdm/tqdm][https_github.com_tqdm_tqdm]

进度条控制显示非常方便。

### sh ###

GitHub：[https://github.com/amoffat/sh][https_github.com_amoffat_sh]

对 Linux 一些命令的封装，简单好用又高效。

### faker ###

GitHub：[https://github.com/joke2k/faker][https_github.com_joke2k_faker]

模拟数据的生成。

个人写的简介：[https://mp.weixin.qq.com/s/iLjr95uqgTclxYfWWNxrAA][https_mp.weixin.qq.com_s_iLjr95uqgTclxYfWWNxrAA]

### arrow、dateutil、dateparser、pendulum ###

GitHub：[https://github.com/crsmithdev/arrow、https://github.com/dateutil/dateutil、https://github.com/scrapinghub/dateparser、https://github.com/sdispater/pendulum][https_github.com_crsmithdev_arrow_https_github.com_dateutil_dateutil_https_github.com_scrapinghub_dateparser_https_github.com_sdispater_pendulum]

时间解析和处理库，非常方便。arrow 目前 Star 最多，好评最多。

### yagmail ###

GitHub：[https://github.com/kootenpv/yagmail][https_github.com_kootenpv_yagmail]

方便的发邮件库，替代自带的 smtplib。

### chardet ###

GitHub：[https://github.com/chardet/chardet][https_github.com_chardet_chardet]

字符串类型编码检测。

### pypinyin ###

GitHub：[https://github.com/mozillazg/python-pinyin][https_github.com_mozillazg_python-pinyin]

汉字转拼音，在一些中文转化处理上很有用。

个人写的简介：[https://mp.weixin.qq.com/s/NvA3j8Ns1-6CFgWpUcWwQw][https_mp.weixin.qq.com_s_NvA3j8Ns1-6CFgWpUcWwQw]

### sphinx ###

Docs：[https://www.sphinx-doc.org/en/master/][https_www.sphinx-doc.org_en_master]

编写文档使用，大多数 Python 库文档都是这个写的，如 Scrapy、requests。

个人 sphinx + markdown 的样例：[https://github.com/Gerapy/Docs][https_github.com_Gerapy_Docs]

### jinja2 ###

GitHub：[https://github.com/pallets/jinja][https_github.com_pallets_jinja]

一个方便的模板引擎，呈现页面时很方便。

### click ###

GitHub：[https://github.com/pallets/click][https_github.com_pallets_click]

更方便灵活地实现命令行传递参数。

### ray ###

GitHub：[https://github.com/ray-project/ray][https_github.com_ray-project_ray]

分布式多进程管理。

### supervisor ###

GitHub：[https://github.com/Supervisor/supervisor][https_github.com_Supervisor_supervisor]

进程管理工具，如实现多任务后台运行，Docker 打包时会经常用到。

### apscheduler ###

GitHub：[https://github.com/agronholm/apscheduler][https_github.com_agronholm_apscheduler]

Python 定时任务，不过 K8S 也可以实现，个人目前可能更倾向于 K8S。

### intelpython ###

Home：[https://software.intel.com/en-us/distribution-for-python][https_software.intel.com_en-us_distribution-for-python]

这不是 Python 库，是一个 Intel 开发的基于 Intel 处理器优化的 Python 解释器，对于大规模运算提升很大。

[https_github.com_python-attrs_attrs_https_github.com_Tinche_cattrs]: https://github.com/python-attrs/attrs%E3%80%81https://github.com/Tinche/cattrs
[https_mp.weixin.qq.com_s_oHK-Y4lOeaQCFtDWgqXxFA]: https://mp.weixin.qq.com/s/oHK-Y4lOeaQCFtDWgqXxFA
[https_github.com_Delgan_loguru]: https://github.com/Delgan/loguru
[https_mp.weixin.qq.com_s_5Ri1WS5cTGCNAQ0I_zYycg]: https://mp.weixin.qq.com/s/5Ri1WS5cTGCNAQ0I_zYycg
[https_github.com_hhatto_autopep8]: https://github.com/hhatto/autopep8
[https_github.com_giampaolo_psutil]: https://github.com/giampaolo/psutil
[https_github.com_gruns_furl]: https://github.com/gruns/furl
[https_github.com_rholder_retrying_https_github.com_jd_tenacity]: https://github.com/rholder/retrying%E3%80%81https://github.com/jd/tenacity
[https_docs.python.org_zh-cn_3_library_typing.html_module-typing]: https://docs.python.org/zh-cn/3/library/typing.html#module-typing
[https_docs.python.org_zh-cn_3_library_argparse.html]: https://docs.python.org/zh-cn/3/library/argparse.html
[https_github.com_abseil_abseil-py]: https://github.com/abseil/abseil-py
[https_github.com_pypa_pipenv]: https://github.com/pypa/pipenv
[https_www.django-rest-framework.org]: https://www.django-rest-framework.org/
[https_github.com_gorakhargosh_watchdog]: https://github.com/gorakhargosh/watchdog
[https_docs.python.org_3_library_glob.html]: https://docs.python.org/3/library/glob.html
[https_docs.python.org_2_library_2to3.html]: https://docs.python.org/2/library/2to3.html
[https_github.com_mahmoud_glom]: https://github.com/mahmoud/glom
[https_docs.python.org_3_library_pathlib.html]: https://docs.python.org/3/library/pathlib.html
[https_github.com_sloria_environs]: https://github.com/sloria/environs
[https_github.com_cool-RR_PySnooper]: https://github.com/cool-RR/PySnooper
[https_github.com_tqdm_tqdm]: https://github.com/tqdm/tqdm
[https_github.com_amoffat_sh]: https://github.com/amoffat/sh
[https_github.com_joke2k_faker]: https://github.com/joke2k/faker
[https_mp.weixin.qq.com_s_iLjr95uqgTclxYfWWNxrAA]: https://mp.weixin.qq.com/s/iLjr95uqgTclxYfWWNxrAA
[https_github.com_crsmithdev_arrow_https_github.com_dateutil_dateutil_https_github.com_scrapinghub_dateparser_https_github.com_sdispater_pendulum]: https://github.com/crsmithdev/arrow%E3%80%81https://github.com/dateutil/dateutil%E3%80%81https://github.com/scrapinghub/dateparser%E3%80%81https://github.com/sdispater/pendulum
[https_github.com_kootenpv_yagmail]: https://github.com/kootenpv/yagmail
[https_github.com_chardet_chardet]: https://github.com/chardet/chardet
[https_github.com_mozillazg_python-pinyin]: https://github.com/mozillazg/python-pinyin
[https_mp.weixin.qq.com_s_NvA3j8Ns1-6CFgWpUcWwQw]: https://mp.weixin.qq.com/s/NvA3j8Ns1-6CFgWpUcWwQw
[https_www.sphinx-doc.org_en_master]: https://www.sphinx-doc.org/en/master/
[https_github.com_Gerapy_Docs]: https://github.com/Gerapy/Docs
[https_github.com_pallets_jinja]: https://github.com/pallets/jinja
[https_github.com_pallets_click]: https://github.com/pallets/click
[https_github.com_ray-project_ray]: https://github.com/ray-project/ray
[https_github.com_Supervisor_supervisor]: https://github.com/Supervisor/supervisor
[https_github.com_agronholm_apscheduler]: https://github.com/agronholm/apscheduler
[https_software.intel.com_en-us_distribution-for-python]: https://software.intel.com/en-us/distribution-for-python