0
Under review
Aleksandr Kurbatov 1 week ago in Crawlera • updated 1 week ago 2

Now any request to site returns 503 error "Website crawl ban" or "Timeout from upstream server".

My plan is C50.


Thanks.

Under review

Hey Aleksandr!


A new version of Crawlera was released today, please check if the issue still there.

Which domain are you trying to crawl?

Best,


Pablo

Problem is still exists.

Domain - citeab .com

Example - https://www.citeab.com/search?q=H00001859-M01


I use headers = {'X-Crawlera-UA': 'desktop',} and it worked well last week.