Skip to content

lfjmgs/QidianCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

起点爬虫

用来爬取起点排行榜数据

条件和依赖

Python 3.4+ Scrapy fonttools Requests

运行

参考Scrapy

爬作品排行榜

默认爬月票榜
scrapy crawl rank

可指定参数type爬其他榜单,如:
scrapy crawl rank -a type=collect // 收藏榜
type参数取自网页url: https://www.qidian.com/rank/collect?style=1

爬粉丝打赏排行榜

默认爬日榜:
scrapy crawl fans-rank

可指定参数type爬总榜:
scrapy crawl fans-rank -a type=2 // 总榜
type参数取自网页url: https://www.qidian.com/rank/fans?dateType=2

Releases

No releases published

Packages

No packages published

Languages