Python 通过URL数据提取之JSON

Love The Way You Lie 2023-10-05 11:26 20阅读 0赞

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70][]

**代码：**

import json
    import  requests
    
    #头部
    headers={
    "user-agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.102 Mobile Safari/537.36"
    }
    
    #url地址
    url="https://movie.douban.com/j/search_subjects?type=movie&tag=%E7%83%AD%E9%97%A8&sort=recommend&page_limit=20&page_start=0"
    response = requests.get(url, headers=headers)
    html_str =response.content.decode()
    # print(html_str)
    
    
    #加载数据,将Json数据转换成python类型(字典dict)
    result=json.loads(html_str)
    # print(result)
    
    #写入
    with open("douban.json","w",encoding="utf-8") as f:
    
        #如果是字典，就不能直接使用的哦！发生异常：TypeError: write() argument must be str, not dict
        # f.write(result)
    
        #解决(1)：必须用json.dumps 把python转换成json字符串
        # f.write(json.dumps(result))
        #加一些参数，自动格式化
        f.write(json.dumps(result,ensure_ascii=False,indent=4))
    
        #解决(2): 也可以直接转换成字符串
        # f.write(str(result))
        pass
    
    
    with open("douban.json","r",encoding="utf-8") as f:
          #读取数据
          res= f.read()
          #加载
          my=json.loads(res)
          print(my)
          #字典
          # print(type(my))

**效果1：**

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70 1][]

![20201010144912245.png][]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70 2][]

####  json.load的使用**:（读取）** ####

#json.load提取类文件对象的数据
    with open("douban.json","r",encoding="utf-8") as f:
          #加载
          my=json.load(f)
          print(my)
          #字典
          print(type(my))

**效果：**

![20201010145931755.png][]

#### json.dump的使用（写入） ####

#json.dump能把python类型放入到类文件对象中
    with open("douban1.json", "w", encoding="utf-8") as f:
        # 加载
        json.dump(result,f,ensure_ascii=False,indent=4)

效果如上效果1

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/20201010145310569.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4,size_16,color_FFFFFF,t_70
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70 1]: https://img-blog.csdnimg.cn/20201010144845896.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4,size_16,color_FFFFFF,t_70
[20201010144912245.png]: https://img-blog.csdnimg.cn/20201010144912245.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4_size_16_color_FFFFFF_t_70 2]: https://img-blog.csdnimg.cn/2020101014595225.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2hseDIwMDgwODA4,size_16,color_FFFFFF,t_70
[20201010145931755.png]: https://img-blog.csdnimg.cn/20201010145931755.png