PyTorch深度学习：60分钟入门与实战（总）

心已赠人 2022-03-28 14:54 257阅读 0赞

> 原文：[github link][]，最新版会首先更新在github上  
> 有误的地方拜托大家指出~

## 简介 ##

此教程的目标：

*  更高层次地理解Pythrch的Tensor库以及神经网络。
 *  训练一个小的神经网络模型用于分类图像。

本教程假设读者对`numpy`有基本的了解

## 环境 ##

*  PyTorch版本0.4及以上（[PyTorch 1.0 **稳定版**][PyTorch 1.0]已经发布，还有什么理由不更新呢~）
 *  [torchvision][] 0.2.1

## 目录 ##

### 什么是PyTorch？（What is PyTorch?） ###

*  [入门][Link 1]
    
     *  [张量][Link 2]
     *  [运算][Link 3]
 *  [NumPy桥][NumPy]
    
     *  [将torch的Tensor转化为NumPy数组][torch_Tensor_NumPy]
     *  [将NumPy数组转化为Torch张量][NumPy_Torch]
 *  [CUDA上的张量][CUDA]

### Autograd：自动求导 ###

*  [张量][Link 4]
 *  [梯度][Link 5]

### 神经网络（Neural Networks） ###

*  [定义网络][Link 6]
 *  [损失函数][Link 7]
 *  [反向传播][Link 8]
 *  [更新权重][Link 9]

### 训练分类器（Training a Classifier） ###

*  [数据呢？][Link 10]
 *  [训练一个图片分类器][Link 11]
    
     *  [1.加载并标准化CIFAR10][1._CIFAR10]
     *  [2.定义卷积神经网络][2.]
     *  [3.定义损失函数和优化器][3.]
     *  [4.训练网络][4.]
     *  [5.使用测试数据测试网络][5.]
 *  [在GPU上训练][GPU]
 *  [在多GPU上训练][GPU 1]
 *  [接下来要做什么？][Link 12]

### 选读：数据并行处理（Optional: Data Parallelism） ###

*  [导入和参数][Link 13]
 *  [虚拟数据集][Link 14]
 *  [简单模型][Link 15]
 *  [创建一个模型和数据并行][Link 16]
 *  [运行模型][Link 17]
 *  [结果][Link 18]
    
     *  [2个GPU][2_GPU]
     *  [3个GPU][3_GPU]
     *  [8个GPU][8_GPU]
 *  [总结][Link 19]

## 版权信息 ##

除非额外说明，本仓库的所有公开文档均遵循 [署名-非商业性使用-相同方式共享 3.0 中国大陆 (CC BY-NC-SA 3.0 CN)][-_-_ 3.0 _ _CC BY-NC-SA 3.0 CN] 许可协议。任何人都可以自由地分享、修改本作品，但必须遵循如下条件：

*  署名：必须提到原作者，提供指向此许可协议的链接，表明是否有做修改
 *  非商业性使用：不能对本作品进行任何形式的商业性使用
 *  相同方式共享：若对本作品进行了修改，必须以相同的许可协议共享

[github link]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn
[PyTorch 1.0]: https://pytorch.org/get-started/locally/
[torchvision]: https://github.com/pytorch/vision
[Link 1]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#%E5%85%A5%E9%97%A8
[Link 2]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#%E5%BC%A0%E9%87%8F
[Link 3]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#%E8%BF%90%E7%AE%97
[NumPy]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#numpy%E6%A1%A5
[torch_Tensor_NumPy]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#%E5%B0%86torch%E7%9A%84tensor%E8%BD%AC%E5%8C%96%E4%B8%BAnumpy%E6%95%B0%E7%BB%84
[NumPy_Torch]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#%E5%B0%86numpy%E6%95%B0%E7%BB%84%E8%BD%AC%E5%8C%96%E4%B8%BAtorch%E5%BC%A0%E9%87%8F
[CUDA]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/What_is_PyTorch/%E4%BB%80%E4%B9%88%E6%98%AFPyTorch.md#cuda%E4%B8%8A%E7%9A%84%E5%BC%A0%E9%87%8F
[Link 4]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Autograd_Automatic_Differentiation/Autograd%EF%BC%9A%E8%87%AA%E5%8A%A8%E6%B1%82%E5%AF%BC.md#%E5%BC%A0%E9%87%8F
[Link 5]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Autograd_Automatic_Differentiation/Autograd%EF%BC%9A%E8%87%AA%E5%8A%A8%E6%B1%82%E5%AF%BC.md#%E6%A2%AF%E5%BA%A6
[Link 6]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Neural_Networks/%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C.md#%E5%AE%9A%E4%B9%89%E7%BD%91%E7%BB%9C
[Link 7]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Neural_Networks/%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C.md#%E6%8D%9F%E5%A4%B1%E5%87%BD%E6%95%B0
[Link 8]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Neural_Networks/%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C.md#%E5%8F%8D%E5%90%91%E4%BC%A0%E6%92%AD
[Link 9]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Neural_Networks/%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C.md#%E6%9B%B4%E6%96%B0%E6%9D%83%E9%87%8D
[Link 10]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#%E6%95%B0%E6%8D%AE%E5%91%A2
[Link 11]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#%E8%AE%AD%E7%BB%83%E4%B8%80%E4%B8%AA%E5%9B%BE%E7%89%87%E5%88%86%E7%B1%BB%E5%99%A8
[1._CIFAR10]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#1%E5%8A%A0%E8%BD%BD%E5%B9%B6%E6%A0%87%E5%87%86%E5%8C%96cifar10
[2.]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#2%E5%AE%9A%E4%B9%89%E5%8D%B7%E7%A7%AF%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C
[3.]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#3%E5%AE%9A%E4%B9%89%E6%8D%9F%E5%A4%B1%E5%87%BD%E6%95%B0%E5%92%8C%E4%BC%98%E5%8C%96%E5%99%A8
[4.]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#4%E8%AE%AD%E7%BB%83%E7%BD%91%E7%BB%9C
[5.]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#5%E4%BD%BF%E7%94%A8%E6%B5%8B%E8%AF%95%E6%95%B0%E6%8D%AE%E6%B5%8B%E8%AF%95%E7%BD%91%E7%BB%9C
[GPU]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#%E5%9C%A8gpu%E4%B8%8A%E8%AE%AD%E7%BB%83
[GPU 1]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#%E5%9C%A8%E5%A4%9Agpu%E4%B8%8A%E8%AE%AD%E7%BB%83
[Link 12]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Training_a_Classifier/%E8%AE%AD%E7%BB%83%E5%88%86%E7%B1%BB%E5%99%A8.md#%E6%8E%A5%E4%B8%8B%E6%9D%A5%E8%A6%81%E5%81%9A%E4%BB%80%E4%B9%88
[Link 13]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E5%AF%BC%E5%85%A5%E5%92%8C%E5%8F%82%E6%95%B0
[Link 14]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E8%99%9A%E6%8B%9F%E6%95%B0%E6%8D%AE%E9%9B%86
[Link 15]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E7%AE%80%E5%8D%95%E6%A8%A1%E5%9E%8B
[Link 16]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E5%88%9B%E5%BB%BA%E4%B8%80%E4%B8%AA%E6%A8%A1%E5%9E%8B%E5%92%8C%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C
[Link 17]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E8%BF%90%E8%A1%8C%E6%A8%A1%E5%9E%8B
[Link 18]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E7%BB%93%E6%9E%9C
[2_GPU]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#2%E4%B8%AAgpu
[3_GPU]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#3%E4%B8%AAgpu
[8_GPU]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#8%E4%B8%AAgpu
[Link 19]: https://github.com/bat67/Deep-Learning-with-PyTorch-A-60-Minute-Blitz-cn/blob/master/Optional_Data_Parallelism/%E6%95%B0%E6%8D%AE%E5%B9%B6%E8%A1%8C%E5%A4%84%E7%90%86.md#%E6%80%BB%E7%BB%93
[-_-_ 3.0 _ _CC BY-NC-SA 3.0 CN]: https://creativecommons.org/licenses/by-nc-sa/3.0/cn/