windows离线安装python3爬虫环境

太过爱你忘了你带给我的痛 2022-12-28 12:42 180阅读 0赞

**目录**

一、离线安装python3.6.8

二、依赖离线模块下载

三、爬虫离线模块安装

四、浏览器驱动下载安装

五、验证版本和依赖

--------------------

## 一、离线安装python3.6.8 ##

python版本下载地址1：[https://www.python.org/downloads/][https_www.python.org_downloads]

python版本下载地址2：[https://www.python.org/ftp/python/3.6.8/][https_www.python.org_ftp_python_3.6.8]

windows安装版：[python-3.6.8-amd64.exe][]

windows绿色版：[python-3.6.8-embed-amd64.zip][]

windows编译版：[Python-3.6.8.tgz][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70][]![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 1][]![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 2][]

##  ##

## 二、依赖离线模块下载 ##

python3.6依赖模块搜索地址：[https://pypi.org/search/?c=Programming+Language+%3A%3A+Python+%3A%3A+3.6][https_pypi.org_search_c_Programming_Language_3A_3A_Python_3A_3A_3.6]

python扩展包镜像网：[https://www.lfd.uci.edu/~gohlke/pythonlibs/][https_www.lfd.uci.edu_gohlke_pythonlibs]

selenium 中文文档：[https://python-selenium-zh.readthedocs.io/zh\_CN/latest/][https_python-selenium-zh.readthedocs.io_zh_CN_latest]

<table>  python爬虫依赖模块地址  
 <tbody> 
  <tr> 
   <td>功能</td> 
   <td>模块</td> 
   <td>官方地址</td> 
   <td>安装包链接</td> 
  </tr> 
  <tr> 
   <td>pip依赖</td> 
   <td>setuptools</td> 
   <td><a href="https://pypi.org/project/setuptools/" rel="nofollow">https://pypi.org/project/setuptools/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/3d/f2/1489d3b6c72d68bf79cd0fba6b6c7497df4ebf7d40970e2d7eceb8d0ea9c/setuptools-51.0.0-py3-none-any.whl" rel="nofollow">setuptools-51.0.0-py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>模块安装工具</td> 
   <td>pip</td> 
   <td><a href="https://pypi.org/project/pip/#files" rel="nofollow">https://pypi.org/project/pip/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/54/eb/4a3642e971f404d69d4f6fa3885559d67562801b99d7592487f1ecc4e017/pip-20.3.3-py2.py3-none-any.whl" rel="nofollow">pip-20.3.3-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>requests依赖库</td> 
   <td>certifi</td> 
   <td><a href="https://pypi.org/project/certifi/" rel="nofollow">https://pypi.org/project/certifi/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/5e/a0/5f06e1e1d463903cf0c0eebeb751791119ed7a4b3737fdc9a77f1cdfb51f/certifi-2020.12.5-py2.py3-none-any.whl" rel="nofollow">certifi-2020.12.5-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>requests依赖库</td> 
   <td>chardet</td> 
   <td><a href="https://pypi.org/project/chardet/" rel="nofollow">https://pypi.org/project/chardet/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/19/c7/fa589626997dd07bd87d9269342ccb74b1720384a4d739a1872bd84fbe68/chardet-4.0.0-py2.py3-none-any.whl" rel="nofollow">chardet-4.0.0-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>requests依赖库</td> 
   <td>idna</td> 
   <td><a href="https://pypi.org/project/idna/" rel="nofollow">https://pypi.org/project/idna/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl" rel="nofollow">idna-2.10-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>requests依赖库</td> 
   <td>urllib3</td> 
   <td><a href="https://pypi.org/project/urllib3/" rel="nofollow">https://pypi.org/project/urllib3/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/f5/71/45d36a8df68f3ebb098d6861b2c017f3d094538c0fb98fa61d4dc43e69b9/urllib3-1.26.2-py2.py3-none-any.whl" rel="nofollow">urllib3-1.26.2-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>http库</td> 
   <td>requests</td> 
   <td><a href="https://pypi.org/project/requests/" rel="nofollow">https://pypi.org/project/requests/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/29/c1/24814557f1d22c56d50280771a17307e6bf87b70727d975fd6b2ce6b014a/requests-2.25.1-py2.py3-none-any.whl" rel="nofollow">requests-2.25.1-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>xml解析库</td> 
   <td>lxml</td> 
   <td><a href="https://pypi.org/project/lxml/" rel="nofollow">https://pypi.org/project/lxml/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/5d/ca/deddbbc1bdfdb423dbc8d778144a05e3dd88a3b470766bd7fbf831b0c8d8/lxml-4.6.2-cp36-cp36m-win_amd64.whl" rel="nofollow">lxml-4.6.2-cp36-cp36m-win_amd64.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>浏览器自动化框架</td> 
   <td>selenium</td> 
   <td><a href="https://pypi.org/project/selenium/" rel="nofollow">https://pypi.org/project/selenium/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl" rel="nofollow">selenium-3.141.0-py2.py3-none-any.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>文字识别库</td> 
   <td>pytesseract</td> 
   <td><a href="https://pypi.org/project/pytesseract/" rel="nofollow">https://pypi.org/project/pytesseract/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/a0/e6/a4e9fc8a93c1318540e8de6d8d4beb5749b7960388a7c7f27799fc2dd016/pytesseract-0.3.7.tar.gz" rel="nofollow">pytesseract-0.3.7.tar.gz&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>tesserocr依赖库</td> 
   <td>tesseract</td> 
   <td><a href="https://pypi.org/project/tesseract/" rel="nofollow">https://pypi.org/project/tesseract/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/8d/b7/c4fae9af5842f69d9c45bf1195a94aec090628535c102894552a7a7dbe6c/tesseract-0.1.3.tar.gz" rel="nofollow">tesseract-0.1.3.tar.gz&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>图像识别库</td> 
   <td>tesserocr</td> 
   <td><a href="https://pypi.org/project/tesserocr/" rel="nofollow">https://pypi.org/project/tesserocr/</a>&nbsp; &nbsp; &nbsp;<br><a href="https://github.com/simonflueckiger/tesserocr-windows_build/releases" rel="nofollow">https://github.com/simonflueckiger/tesserocr-windows_build/releases</a></td> 
   <td> <p><a href="https://files.pythonhosted.org/packages/9b/98/b4a534c4f3da4163c8c3d4dfdb1619748b7fe7d8c4fc4718cad3cda55e32/tesserocr-2.5.1.tar.gz" rel="nofollow">tesserocr-2.5.1.tar.gz</a></p> <p><a href="https://github.com/simonflueckiger/tesserocr-windows_build/releases/download/tesserocr-v2.4.0-tesseract-4.0.0/tesserocr-2.4.0-cp36-cp36m-win_amd64.whl" rel="nofollow">tesserocr-2.4.0-cp36-cp36m-win_amd64.whl</a></p> </td> 
  </tr> 
  <tr> 
   <td>文字识别</td> 
   <td>tesseract-ocr</td> 
   <td><a href="https://digi.bib.uni-mannheim.de/tesseract/" rel="nofollow">https://digi.bib.uni-mannheim.de/tesseract/</a></td> 
   <td> <p><a href="https://digi.bib.uni-mannheim.de/tesseract/tesseract-ocr-w64-setup-v4.0.0.20181030.exe" rel="nofollow">tesseract-ocr-w64-setup-v4.0.0.20181030.exe</a></p> </td> 
  </tr> 
  <tr> 
   <td>矩阵数组计算库</td> 
   <td>numpy</td> 
   <td><a href="https://pypi.org/project/numpy/" rel="nofollow">https://pypi.org/project/numpy/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/33/26/c448c5203823d744b7e71b81c2b6dcbcd4bff972897ce989b437ee836b2b/numpy-1.19.4-cp36-cp36m-win_amd64.whl" rel="nofollow">numpy-1.19.4-cp36-cp36m-win_amd64.whl&nbsp;</a></td> 
  </tr> 
  <tr> 
   <td>计算机视觉库</td> 
   <td>opencv-python</td> 
   <td><a href="https://pypi.org/project/opencv-python/" rel="nofollow">https://pypi.org/project/opencv-python/</a></td> 
   <td><a href="https://files.pythonhosted.org/packages/b5/73/62568302eeff97fd0fb4517f94cb4693ecfc0f890c21f9def587d9229379/opencv_python-4.4.0.46-cp36-cp36m-win_amd64.whl" rel="nofollow">opencv_python-4.4.0.46-cp36-cp36m-win_amd64.whl&nbsp;</a></td> 
  </tr> 
 </tbody> 
</table>

##  ##

## 三、爬虫离线模块安装 ##

**1、whl依赖包离线安装**

python -m pip install --upgrade setuptools-51.0.0-py3-none-any.whl 
    python -m pip install --upgrade pip-20.3.3-py2.py3-none-any.whl

python -m pip install certifi-2020.12.5-py2.py3-none-any.whl 
    python -m pip install chardet-4.0.0-py2.py3-none-any.whl 
    python -m pip install idna-2.10-py2.py3-none-any.whl 
    python -m pip install urllib3-1.26.2-py2.py3-none-any.whl 
    python -m pip install requests-2.25.1-py2.py3-none-any.whl 
    python -m pip install lxml-4.6.2-cp36-cp36m-win_amd64.whl 
    python -m pip install selenium-3.141.0-py2.py3-none-any.whl 
    python -m pip install tesserocr-2.4.0-cp36-cp36m-win_amd64.whl
    python -m pip install numpy-1.19.4-cp36-cp36m-win_amd64.whl
    python -m pip install opencv_python-4.4.0.46-cp36-cp36m-win_amd64.whl

**2、tar.gz依赖包离线安装**  
解压之后 cd 进入目录执行

python setup.py install

**3、tesseract-ocr安装**

Python tesserocr的安装教程：[https://jingyan.baidu.com/article/6b18230972e3e6fb59e15909.html][https_jingyan.baidu.com_article_6b18230972e3e6fb59e15909.html]

（1）安装时选择多语言数据下载

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 3][]

（2）将 Tesseract-OCR 添加到环境变量

（3）安装成功之后需要将 Tesseract-OCR 根目录下的 tessdata 文件夹复制到 Python 根目录下，否则会出现报错

RuntimeError: Failed to init API, possibly an invalid tessdata path: D:\Python\Python36\Python368\/tessdata/

（4）指定变量 tesseract\_cmd 为 安装的 tesseract.exe 文件

from PIL import Image
    import pytesseract
    ## 引用 pytesseract 模块需要手动修改 tesseract_cmd 变量的依赖地址
    pytesseract.pytesseract.tesseract_cmd = r'D:\Python\install-depend\Tesseract-OCR\tesseract.exe'

##  ##

## 四、浏览器驱动下载安装 ##

<table>  selenium webdriver download  
 <tbody> 
  <tr> 
   <td>模拟浏览器</td> 
   <td>查看版本</td> 
   <td>镜像地址</td> 
   <td>驱动下载&nbsp;</td> 
  </tr> 
  <tr> 
   <td>谷歌浏览器</td> 
   <td>chrome://version/</td> 
   <td><a href="http://chromedriver.storage.googleapis.com/index.html" rel="nofollow">http://chromedriver.storage.googleapis.com/index.html</a>&nbsp; &nbsp;&nbsp;<a href="http://npm.taobao.org/mirrors/chromedriver" rel="nofollow">http://npm.taobao.org/mirrors/chromedriver</a></td> 
   <td><a href="http://chromedriver.storage.googleapis.com/86.0.4240.22/chromedriver_win32.zip" rel="nofollow">chromedriver_win32.zip</a></td> 
  </tr> 
  <tr> 
   <td>火狐浏览器</td> 
   <td>about:support</td> 
   <td> <p><a href="https://npm.taobao.org/mirrors/geckodriver" rel="nofollow">https://npm.taobao.org/mirrors/geckodriver</a></p> <p><a href="https://github.com/mozilla/geckodriver/releases" rel="nofollow">https://github.com/mozilla/geckodriver/releases</a></p> </td> 
   <td><a href="https://npm.taobao.org/mirrors/geckodriver/v0.26.0/geckodriver-v0.26.0-win64.zip" rel="nofollow">geckodriver-v0.26.0-win64.zip</a></td> 
  </tr> 
  <tr> 
   <td>微软浏览器</td> 
   <td>edge://version/</td> 
   <td><a href="https://developer.microsoft.com/en-us/microsoft-edge/tools/webdriver/" rel="nofollow">https://developer.microsoft.com/en-us/microsoft-edge/tools/webdriver/</a></td> 
   <td><a href="https://msedgedriver.azureedge.net/87.0.664.60/edgedriver_win64.zip" rel="nofollow">edgedriver_win64.zip</a></td> 
  </tr> 
  <tr> 
   <td>opera浏览器</td> 
   <td></td> 
   <td><a href="https://github.com/operasoftware/operachromiumdriver/releases" rel="nofollow">https://github.com/operasoftware/operachromiumdriver/releases</a></td> 
   <td><a href="https://github.com/operasoftware/operachromiumdriver/releases/download/v.87.0.4280.67/operadriver_win64.zip" rel="nofollow">operadriver_win64.zip</a></td> 
  </tr> 
  <tr> 
   <td>IE浏览器</td> 
   <td>设置 -&nbsp;关于IE</td> 
   <td><a href="http://selenium-release.storage.googleapis.com/index.html" rel="nofollow">http://selenium-release.storage.googleapis.com/index.html</a></td> 
   <td><a href="http://selenium-release.storage.googleapis.com/3.9/IEDriverServer_x64_3.9.0.zip" rel="nofollow">IEDriverServer_x64_3.9.0.zip</a></td> 
  </tr> 
  <tr> 
   <td>PhantomJS</td> 
   <td></td> 
   <td><a href="https://phantomjs.org/download.html" rel="nofollow">https://phantomjs.org/download.html</a>&nbsp; &nbsp;<a href="https://bitbucket.org/ariya/phantomjs/downloads" rel="nofollow">https://bitbucket.org/ariya/phantomjs/downloads</a></td> 
   <td><a href="https://bitbucket.org/ariya/phantomjs/downloads/phantomjs-2.1.1-windows.zip" rel="nofollow">phantomjs-2.1.1-windows.zip</a></td> 
  </tr> 
 </tbody> 
</table>

##  ##

## 五、验证版本和依赖 ##

python -V
    // Python 3.6.8
    python
    import platform
    platform.architecture()
    // ('64bit', 'WindowsPE')
    import requests
    import lxml
    import seleninm
    from PIL import Image
    import pytesseract
    import tesserocr
    import cv2 as cv

[https_www.python.org_downloads]: https://www.python.org/downloads/
[https_www.python.org_ftp_python_3.6.8]: https://www.python.org/ftp/python/3.6.8/
[python-3.6.8-amd64.exe]: https://www.python.org/ftp/python/3.6.8/python-3.6.8-amd64.exe
[python-3.6.8-embed-amd64.zip]: https://www.python.org/ftp/python/3.6.8/python-3.6.8-embed-amd64.zip
[Python-3.6.8.tgz]: https://www.python.org/ftp/python/3.6.8/Python-3.6.8.tgz
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20201217140318863.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20201217140325175.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 2]: /images/20221120/75f997f9369e4a6dba640c15ab7f07ea.png
[https_pypi.org_search_c_Programming_Language_3A_3A_Python_3A_3A_3.6]: https://pypi.org/search/?c=Programming+Language+%3A%3A+Python+%3A%3A+3.6
[https_www.lfd.uci.edu_gohlke_pythonlibs]: https://www.lfd.uci.edu/~gohlke/pythonlibs/
[https_python-selenium-zh.readthedocs.io_zh_CN_latest]: https://python-selenium-zh.readthedocs.io/zh_CN/latest/
[https_jingyan.baidu.com_article_6b18230972e3e6fb59e15909.html]: https://jingyan.baidu.com/article/6b18230972e3e6fb59e15909.html
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxMjYyNTkzNDIx_size_16_color_FFFFFF_t_70 3]: /images/20221120/312a1162865d467c8f07b8619a3ae4c3.png