-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Example Usage (Basic Recommendation)
Jeremy Chou edited this page Jun 1, 2023
·
1 revision
Here are some basic recommend settings to follow
DUPEFILTER_CLASS = "scrapy_redis.dupefilter.RFPDupeFilter"
SCHEDULER = "scrapy_redis.scheduler.Scheduler"
SCHEDULER_ORDER = 'BFO'
SCHEDULER_PERSIST = True
SCHEDULER_QUEUE_CLASS = 'scrapy_redis.queue.SpiderPriorityQueue'
REDIS_URL = None
REDIS_HOST = '127.0.0.1'
REDIS_PORT = 6379