爬虫之多线程,提高效率
时间:2021-02-20 11:52:43
收藏:0
阅读:0

arr = ["http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3", "http://music.163.com/song/media/outer/url?id=1820550501.mp3"] import random def downsong(url): res = requests.get(url,headers=headers) with open(f"D://music/{str(random.randint(1,100))}.mp3","wb")as f: f.write(res.content) from multiprocessing.dummy import Pool p = Pool(4) p.map(downsong,arr) print("下载完毕")
下载网易云 使用多线程爬虫
评论(0)