Start a new topic
Answered

API Run Job fails frequently

I've started using your API to run a job daily.


It uses the call:

https://app.scrapinghub.com/api/run.json


My log shows the following jobs have failed:

1/179

1/182

1/186


Also job 1/183 failed when ran from: https://app.scrapinghub.com/p/yyyyyyy/jobs


where yyyyyyy is my project ID.


 

The error message for all of these failures is:

requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url:https://portia.scrapinghub.com/api/projects/182666/download/xxxxxxxxxxxx


where xxxxxxxxxxxx is the name of my spider.



Oddly enough ScrapingHub was error free for many months, before you announced the end of scheduled jobs for customers on the free plan...


Best Answer

John, 


The 502 error is unrelated to the end of periodic jobs for free plan. We are aware of the sporadic 502s and we have restarted our backend instance that should mitigate the problem. Please retry and let us know if you are still experiencing those failures. 

1 Comment

Answer

John, 


The 502 error is unrelated to the end of periodic jobs for free plan. We are aware of the sporadic 502s and we have restarted our backend instance that should mitigate the problem. Please retry and let us know if you are still experiencing those failures. 

Login to post a comment