爬取CSDN百度搜索词制作词云图

柔情只为你懂 2022-04-23 09:30 331阅读 0赞

### 通过Python爬取CSDN百度关键页的搜索词和入口页次数，通过Word Art制作词云图。 ###

**效果：**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NoazIxOA_size_16_color_FFFFFF_t_70][]

--------------------

**login.py（登录CSDN）**

# -*- coding: utf-8 -*-
    from selenium import webdriver
    from selenium.webdriver.chrome.options import Options
    import time
    
    username = "账号"
    password = "密码"
    
    
    def run():
        chrome_options = Options()
        chrome_options.add_argument('--headless')
        chrome_options.add_argument('--disable-gpu')
        browser = webdriver.Chrome(chrome_options=chrome_options)
        browser.get(url="https://passport.csdn.net/login")  # get访问url
        browser.find_element_by_xpath('//*[@id="app"]/div/div/div/div[2]/div[2]/ul/li[1]/a').click()
        browser.find_element_by_xpath('//*[@id="all"]').send_keys(username)
        browser.find_element_by_xpath('//*[@id="password-number"]').send_keys(password)
        browser.find_element_by_xpath('//*[@id="app"]/div/div/div/div[2]/div[2]/form/div/div[6]/div/button').click()
        time.sleep(1)
        cookie = browser.get_cookies()
        cookies = {}
        for co in cookie:
            cookies[co["name"]] = co["value"]
        with open('cookie.json', 'w') as f:
            f.write(str(cookies))
        print("登陆成功！")
        browser.quit()

--------------------

**main.py（爬取搜索词和入口页次数）**

# -*- coding: utf-8 -*-
    import requests
    from pyquery import PyQuery as pq
    import login
    
    
    def pa():
        login.run()  # 登录
        with open("cookie.json", "r") as file:
            cookie = eval(file.read())
        file.close()
    
        # 验证cookie
        h1 = requests.get("https://me.csdn.net/api/user/show", cookies=cookie)
        if h1.json()["code"] != 200:
            login.run()  # 登录
            with open("cookie.json", "r") as file:
                cookie = eval(file.read())
    
        h2 = requests.get("https://mp.csdn.net/data/baidukeyword", cookies=cookie)
        h3 = pq(h2.text)("tbody")("tr").items()
        statistical = ""
        for h4 in h3:
            h5 = h4("td:not([rowspan])")
            keyword = h5.eq(0).text()
            number = h5.eq(2).text()
            statistical += keyword + " " + str(number) + "\n"
        print(statistical)
    
    
    if __name__ == "__main__":
        pa()

--------------------

**使用Word Art制作词云图【[Word Art][]】**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NoazIxOA_size_16_color_FFFFFF_t_70 1][]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NoazIxOA_size_16_color_FFFFFF_t_70]: /images/20220321/7eddc1c566d7407599ac86e293921126.png
[Word Art]: https://wordart.com
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NoazIxOA_size_16_color_FFFFFF_t_70 1]: /images/20220321/7fdee3d4c0f74db586ec4c105c5905e6.png