Python中利用正则表达式做数据清洗（re）

系统管理员 2022-12-09 04:54 492阅读 0赞

### 目录 ###

*  1.常用正则表达式
 *   *   *  Python中常用正则表达式
 *  2.正则表达式做数据清洗
 *   *  2.1 从网页HTML标签中提取文本
     *  2.2 去掉英文文章中标点符号，提取词汇
     *  2.3 提取以.com结尾的邮箱

# 1.常用正则表达式 #

### [Python中常用正则表达式][Python] ###

# 2.正则表达式做数据清洗 #

## 2.1 从网页HTML标签中提取文本 ##

import re
 text = "<div>\n你好\nPython：Python是一种跨平台的计算机程序设计语言。 是一个高层次的结合了解释性、编译性、互动性和面向对象的脚本语言。最初被设计用于编写自动化脚本(shell)，随着版本的不断更新和语言新功能的添加，越多被用于独立的、大型项目的开发。  <a>快来学习Python吧！</a></div>"
 result = re.sub(r"<.*?>| |\n", "", text)
 print(result)

输出：

![在这里插入图片描述][20200921215338619.png_pic_center]

## 2.2 去掉英文文章中标点符号，提取词汇 ##

import re
    text = "This isn't to be alarmist. (Optimists point out that technological upheaval has benefited workers in the past.) The Industrial Revolution didn't go so well for Luddites whose jobs were displaced by mechanized looms, but it eventually raised living standards and created more jobs than it destroyed. Likewise, automation should eventually boost productivity, stimulate demand by driving down prices, and free workers from hard, boring work. But in the medium term, middle-class workers may need a lot of help adjusting."
    result = re.sub(r"[^A-Za-z]", " ", text)
    print(result)

输出：

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0FydGlmaWNpYWxfaWRpb3Rz_size_16_color_FFFFFF_t_70_pic_center]

## 2.3 提取以.com结尾的邮箱 ##

import re
    text = "adjhuw_@163.com, qux3349@qq.com, nihaomatt@126.xxx, asdfghj@sina.com, abc@139.org"
    result = re.findall(r"[a-zA-Z0-9_]+@[a-zA-Z0-9_]+\.com", text)
    print(result)

输出：

![在这里插入图片描述][20200921221141755.png_pic_center]

[Python]: https://blog.csdn.net/Artificial_idiots/article/details/107282250
[20200921215338619.png_pic_center]: /images/20221123/1352c5e0c349429b8af2a100963d480f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0FydGlmaWNpYWxfaWRpb3Rz_size_16_color_FFFFFF_t_70_pic_center]: /images/20221123/789c119e3a8a4509866545378347a99e.png
[20200921221141755.png_pic_center]: /images/20221123/48a007ba2ef845318a49708660f42c88.png