I want to run a job using jobs API.
I am passing the project id and the spider name.
I would like to pass arguments to the spider as well.
Any parameter not listed here: https://doc.scrapinghub.com/api/jobs.html#run-json, will be treated as an argument. That means you can pass arguments like this:
$ curl -u APIKEY: https://app.scrapinghub.com/api/run.json -d project=123 -d spider=somespider -d spiderarg1=example
me too
how to capture the argument spiderarg1=example in this spider?
Avishay Balderman
I want to run a job using jobs API.
I am passing the project id and the spider name.
I would like to pass arguments to the spider as well.
Any parameter not listed here: https://doc.scrapinghub.com/api/jobs.html#run-json, will be treated as an argument. That means you can pass arguments like this:
- Oldest First
- Popular
- Newest First
Sorted by Oldest FirstMarcos Machado
me too
nestor
Any parameter not listed here: https://doc.scrapinghub.com/api/jobs.html#run-json, will be treated as an argument. That means you can pass arguments like this:
1 person likes this
saptadiparc
how to capture the argument spiderarg1=example in this spider?
-
Unable to select Scrapy project in GitHub
-
ScrapyCloud can't call spider?
-
Unhandled error in Deferred
-
Item API - Filtering
-
newbie to web scraping but need data from zillow
-
ValueError: Invalid control character
-
Cancelling account
-
Best Practices
-
Beautifulsoup with ScrapingHub
-
Delete a project in ScrapingHub
See all 182 topics