Start a new topic
Answered

IP not rotating

Hello,


I was interested, so set up a little test for SH. And scraped www.whatismybrowser.com for the IP address and the user-agent, and it uses the same IP address and User-Agent for the entire crawl.


Why is this if we are using Crawlkera?





Best Answer

I checked the logs and there's just 1 request from your user to that website and it returned a 301. So it seems like a configuration issue on your side and the requests were not going through Crawlera but your own IP.


type (Crawlkera) = Crawlera 

Answer

I checked the logs and there's just 1 request from your user to that website and it returned a 301. So it seems like a configuration issue on your side and the requests were not going through Crawlera but your own IP.

Thank you. I have asked our Dev to confirm the design so we're not out of alignment. 


Were you able to sort this out?

Login to post a comment