Start a new topic
Answered

High number of requests?

Just finished a small job, and I was just wondering if this is normal? Items scraped were 521, but 2615 requests,and a number of them had no scrapes. 


Could you advise please? 


kelvinc



image



Best Answer

Hey Kelvin,


Looks normal from platform side. Sometimes the scraper just don't extract all the data since is necessary further configurations or a more robust crawler using Scrapy.


Please check this article to know more.


Best,


Pablo

1 Comment

Answer

Hey Kelvin,


Looks normal from platform side. Sometimes the scraper just don't extract all the data since is necessary further configurations or a more robust crawler using Scrapy.


Please check this article to know more.


Best,


Pablo

Login to post a comment