It can be implemented by combining Scrapy Signals with a job scheduling API call (see Jobs API and Scrapinghub's Python client). The idea is to catch the spider_closed signal and trigger the next job via API or the client.
Modified on: Wed, 2 Oct, 2019 at 5:28 PM
Did you find it helpful?Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.