0
Not a bug
radachynskaja 1 month ago in Portia • updated by Pablo Vaz (Support Engineer) 1 month ago 2

none of these pages load any more in portia spider editing tool. I've tried to recreate the spider but it doesn't help is there anything that I'm doing wrong? I've followed the tutorials step by step and am able to get the data from other similar pages, but portia fails on these specific sites - they just don't open in portia spider editing tool:


1) anthonysheatingoilri.com - scraper doesn't process html tags/no elements can be selected:
2) anthonysoil.com - scraper doesn't process html tags/no elements can be selected:

3) scraper doesn't process html tags/no elements can be selected:


4) big-oats.com - can't select the particular element on the page. Nothing gets parsed (0 results):

Answer

Answer
Not a bug

Hi Rj and Markus,


We have been doing some maintenance tasks lastly so with our last release Portia should be working stable.


About specific domains, sometimes Portia can't handle complex components of the site and fails to extract data. Keep in mind that this tool was designed for easy and mid size projects. If interested to develop more powerful extractors, you should consider using Scrapy: https://doc.scrapy.org/en/latest/intro/tutorial.html

And deploy your projects for free in our Scrapy Cloud.


You can also hire our experts to set a specific crawler for your needs. If interested, don't hesitate to request our free quote form: https://scrapinghub.com/quote


Kind regards,


Pablo Vaz

Support Team

I've had similar problems with my projects. Think there's something wrong with the app at the moment.

Answer
Not a bug

Hi Rj and Markus,


We have been doing some maintenance tasks lastly so with our last release Portia should be working stable.


About specific domains, sometimes Portia can't handle complex components of the site and fails to extract data. Keep in mind that this tool was designed for easy and mid size projects. If interested to develop more powerful extractors, you should consider using Scrapy: https://doc.scrapy.org/en/latest/intro/tutorial.html

And deploy your projects for free in our Scrapy Cloud.


You can also hire our experts to set a specific crawler for your needs. If interested, don't hesitate to request our free quote form: https://scrapinghub.com/quote


Kind regards,


Pablo Vaz

Support Team