在Scrapy中添加Cookie
时间:2021-06-25 16:45:37
收藏:0
阅读:0
1.在settings中开启Cookie
COOKIES_ENABLED = True
2.重写 start_requests方法 初始化开始url(方便添加cookie)
列:
from scrapy import Request class ASpider(CrawlSpider): name = ‘A‘ allowed_domains = [‘m.win4000.com‘] def start_requests(self): #爬虫开始地址 url = "http://m.win4000.com/wallpaper.html" #爬取所需的cookie cookieDir = { "r":"561", "t":"6ae405c3cec1ed393b2f05ba06a3500d", } yield Request(url,cookies=cookieDir)
评论(0)