0
han 1 week ago in Scrapy Cloud 0

Hi there, I started using scrapinghub a week ago, and have been using it to scrape some ecommerce websites.


I notice that the crawl job for a particular website keeps ending prematurely without any error logs.

On some instances, I try to visit the website and I found out that I got blocked.

So, I activated crawlera and the results is the same.


What could I be missing out?