虚拟换装知识脉络

太过爱你忘了你带给我的痛 2022-10-07 14:49 201阅读 0赞

近年来，随着电商的兴起，大量的关于虚拟试衣的论文被发表。本文梳理一下相关脉络。

**目录**

3D方法

2D方法

数据集

相关论文链接

--------------------

# 3D方法 #

纯粹基于3D的方法未详细调研，其实大部分基于2D的方法也是2D和3D相结合的方法实现的。

本人未详细调研，此处没详细归纳。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70][]

# 2D方法 #

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70 1][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70 2][]

# 数据集 #

大多使用，VITON数据集

[\[paper\]VITON: An Image-based Virtual Try-on Network(2018)][paper_VITON_ An Image-based Virtual Try-on Network_2018]  
[\[code\]VITON][code_VITON]

# 相关论文链接 #

VITON:An Image-based Virtual Try-on Network(2018) Xintong Han, Zuxuan Wu, Zhe Wu, Ruichi Yu, and Larry S Davis. Viton: An image-based virtual try-on network. In CVPR, 2018

[\[paper\]VITON: An Image-based Virtual Try-on Network(2018)][paper_VITON_ An Image-based Virtual Try-on Network_2018]  
[\[code\]VITON][code_VITON]

介绍：[基于图像的虚拟试衣：VITON:An Image-based Virtual Try-on Network(2018)\_studyeboy的专栏-CSDN博客][VITON_An Image-based Virtual Try-on Network_2018_studyeboy_-CSDN]

ECCV2018

论文地址：[\[1807.07688\] Toward Characteristic-Preserving Image-based Virtual Try-On Network (arxiv.org)][1807.07688_ Toward Characteristic-Preserving Image-based Virtual Try-On Network _arxiv.org]

[ \[论文笔记\]Toward Characteristic-Preserving Image-based Virtual Try-On Network\_weixin\_30244681的博客-CSDN博客][Toward Characteristic-Preserving Image-based Virtual Try-On Network_weixin_30244681_-CSDN]

CVPR 2017  I. Rocco, R. Arandjelovi´ c, and J. Sivic. Convolutional neural network architecture for geometric matching. In CVPR, 2017

paper: [\[1703.05593v2\] Convolutional neural network architecture for geometric matching (arxiv.org)][1703.05593v2_ Convolutional neural network architecture for geometric matching _arxiv.org]

Haoye Dong, Xiaodan Liang, Ke Gong, Hanjiang Lai, Jia Zhu, and Jian Yin. Soft-gated warping-gan for pose-guided person image synthesis. In NeurIPS, 2018

NIPS2018 [\[1810.11610v2\] Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis (arxiv.org)][1810.11610v2_ Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis _arxiv.org]

Xintong Han, Xiaojun Hu, Weilin Huang, and Matthew R. Scott. Clothflow: A flow-based model for clothed person generation. In ICCV, 2019

ICCV2019  [ClothFlow: A Flow-Based Model for Clothed Person Generation | IEEE Conference Publication | IEEE Xplore][ClothFlow_ A Flow-Based Model for Clothed Person Generation _ IEEE Conference Publication _ IEEE Xplore]

Han Yang, Ruimao Zhang, Xiaobao Guo, Wei Liu, Wang-meng Zuo, and Ping Luo. Towards photo-realistic virtual try-on by adaptively generating preserving image content.

In CVPR, 2020

CVPR 2020 Towards photo-realistic virtual try-on by adaptively generating preserving image content.

[Towards Photo-Realistic Virtual Try-On by Adaptively Generating$\\\\leftrightarrow$Preserving Image Content - 百度学术 (baidu.com)][Towards Photo-Realistic Virtual Try-On by Adaptively Generating_leftrightarrow_Preserving Image Content - _ _baidu.com]

Assaf Neuberger, Eran Borenstein, Bar Hilleli, Eduard Oks, and Sharon Alpert. Image based virtual try-on network from unpaired data. In CVPR, 2020

[scipub-1281.pdf (amazon.science)][scipub-1281.pdf _amazon.science]

CVPR 2020 Image Based Virtual Try-on Network from Unpaired Data

代码：[GitHub - trinanjan12/Image-Based-Virtual-Try-on-Network-from-Unpaired-Data][GitHub - trinanjan12_Image-Based-Virtual-Try-on-Network-from-Unpaired-Data]

Surgan Jandial, Ayush Chopra, Kumar Ayush, Mayur Hemani, Abhijeet Kumar, and Balaji Krishnamurthy. Sievenet: A unified framework for robust image-based virtual try-on.

In WACV, 2020

WACV 2020 [\[2001.06265v1\] SieveNet: A Unified Framework for Robust Image-Based Virtual Try-On (arxiv.org)][2001.06265v1_ SieveNet_ A Unified Framework for Robust Image-Based Virtual Try-On _arxiv.org]

Thibaut Issenhuth, J. Mary, and Clément Calauzènes. Do not mask what you do not need to mask: a parser-free virtual try-on. ECCV, 2020.

ECCV 2020, Do not mask what you do not need to mask: a parser-free virtual try-on.

[\[2007.02721v2\] Do Not Mask What You Do Not Need to Mask: a Parser-Free Virtual Try-On (arxiv.org)][2007.02721v2_ Do Not Mask What You Do Not Need to Mask_ a Parser-Free Virtual Try-On _arxiv.org]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70]: /images/20221005/d79f8c69ec7b4ae08a03136c4cb5bdbb.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70 1]: /images/20221005/e274f5a5ec2e42b98ab84cedb035f740.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl8zNjQ3NDgwOQ_size_16_color_FFFFFF_t_70 2]: /images/20221005/ddcdd7316dc448daa930ee26e792ed46.png
[paper_VITON_ An Image-based Virtual Try-on Network_2018]: https://arxiv.org/pdf/1711.08447v4.pdf
[code_VITON]: https://github.com/xthan/VITON
[VITON_An Image-based Virtual Try-on Network_2018_studyeboy_-CSDN]: https://blog.csdn.net/studyeboy/article/details/115693011
[1807.07688_ Toward Characteristic-Preserving Image-based Virtual Try-On Network _arxiv.org]: https://arxiv.org/abs/1807.07688
[Toward Characteristic-Preserving Image-based Virtual Try-On Network_weixin_30244681_-CSDN]: https://blog.csdn.net/weixin_30244681/article/details/98583925
[1703.05593v2_ Convolutional neural network architecture for geometric matching _arxiv.org]: https://arxiv.org/abs/1703.05593v2
[1810.11610v2_ Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis _arxiv.org]: https://arxiv.org/abs/1810.11610v2
[ClothFlow_ A Flow-Based Model for Clothed Person Generation _ IEEE Conference Publication _ IEEE Xplore]: https://ieeexplore.ieee.org/document/9010778
[Towards Photo-Realistic Virtual Try-On by Adaptively Generating_leftrightarrow_Preserving Image Content - _ _baidu.com]: https://xueshu.baidu.com/usercenter/paper/show?paperid=1t1a0rs07u2t00605h6e0x7062412911
[scipub-1281.pdf _amazon.science]: https://assets.amazon.science/1a/2b/7a4dd8264ce19a959559da799aff/scipub-1281.pdf
[GitHub - trinanjan12_Image-Based-Virtual-Try-on-Network-from-Unpaired-Data]: https://github.com/trinanjan12/Image-Based-Virtual-Try-on-Network-from-Unpaired-Data
[2001.06265v1_ SieveNet_ A Unified Framework for Robust Image-Based Virtual Try-On _arxiv.org]: https://arxiv.org/abs/2001.06265v1
[2007.02721v2_ Do Not Mask What You Do Not Need to Mask_ a Parser-Free Virtual Try-On _arxiv.org]: https://arxiv.org/abs/2007.02721v2