Vinc 1 week ago in Crawlera 0


I know this is not a normal use for Crawlera, I'm crawling a site that's very picky about the IP one crawls from, up until one manages to register and login.

So I need to manually log in the site and get the session cookies before I can start crawling, and since my IP is generally blocked to do that, I wanted to use Crawlera with my browser.

So far I managed to get Chrome+FoxyProxy to work with HTTP connections, however whenever I get to an HTTPS Chrome returns an ERR_CONNECTION_CLOSED error.

Anybody knows how to get this to work? It doesn't necessarily need to be Chrome with foxyproxy, anything that would allow me to browse a simple page would work really (polipo? firefox? squid?)