Crawlera Advanced Topics

Using Crawlera Sessions to make multiple requests from the same IP
With Crawlera, each request is routed through a different outgoing IPs. To make requests using the same IP you need to use Sessions. Each session will inter...
Mon, 30 Jul, 2018 at 5:06 PM
Understanding Crawlera errors
When a request fails for some reason, Crawlera will include an error code in the X-Crawlera-Error header. Please refer to the API documentation to understan...
Wed, 26 Apr, 2017 at 3:58 PM
Desktop and Mobile Profiles
X-Crawlera-Profile is a header that is meant to replace X-Crawlera-UA. It not only sets the User-Agent but also applies a set of headers which are actually ...
Wed, 4 Jul, 2018 at 8:40 PM
How to deal with bans ( '503' responses from Crawlera)
When Crawlera gets a ban from a target website, it automatically retries the request from another proxy IP.  By default, Crawlera re-tries 5 times to ret...
Wed, 22 Aug, 2018 at 5:08 PM