Python爬虫实践:常见HTTP请求问题解析
在Python爬虫中,处理HTTP请求问题是常见的挑战。这里我们将解析一些常见的HTTP请求问题:
发起GET请求:
import requests
url = "http://example.com"
response = requests.get(url)
if response.status_code == 200:
print("GET request successful.")
content = response.text
# 处理获取内容
else:
print(f"GET request failed with status {response.status_code}."))
处理POST请求:
import requests
url = "http://example.com/api/data"
data = {"key1": "value1", "key2": "value2"}
response = requests.post(url, json=data)
if response.status_code == 201:
print("POST request successful.")
content = response.json()
# 处理返回内容
else:
print(f"POST request failed with status {response.status_code}."))
处理重定向:
import requests
url = "http://example.com/redirected"
response = requests.get(url, allow_redirects=True))
if response.status_code == 200:
print("Redirect handled successfully.")
content = response.text
# 处理重定向内容
else:
print(f"Failed to handle redirect with status {response.status_code}."))
通过以上解析,你可以更好地理解和处理在Python爬虫中常见的HTTP请求问题。
还没有评论,来说两句吧...