How can we help you today?

Start a new topic
Discussions Scrapy Cloud Technical Help
Answered

Modify Periodic Jobs Programmatically?

Hello,


Is there any way to create or modify periodic jobs programmatically? I'd like to create a process where I autogenerate spiders and commit them to github, where they are pulled down automatically by ScrapingHub.


Then I'd like to script modifying a periodic job to add new spiders to the job to be run on a periodic basis. 


Is this possible? The Jobs API only seems to be for one-off jobs (https://doc.scrapinghub.com/api/jobs.html).


thanks!

Best Answer

This is a very popular request and we are already working on an API for Periodic Jobs, it should be ready sometime this year. For now, the only option is to do it via the UI.

2 CommentsSorted by Oldest First
Answer

This is a very popular request and we are already working on an API for Periodic Jobs, it should be ready sometime this year. For now, the only option is to do it via the UI.

Hi, any update on when this feature will be available?

1 person likes this
Login to post a comment
More topics in Technical Help
See all 251 topics