Start a new topic
Answered

Question regarding multiple page scraping

Hi everyone. So the video on how to scrape multiple pages in Portia is very helpful, but I have run into an issue. 


On the page I am looking to scrape, the "next" button does not have an associated link - it is embedded in the webpage. So this is an attendee list with headings such as "Name, Company, State" and then there are 124 pages with around 50 records per page in a table format. When you click the "next" the URL literally stays the same. 

How do I scrape this with Portia. 

THANK YOU! 


Best Answer

Hi Prog,


If the suggested approach doesn't help, you should consider to use another tool like Scrapy spider with Splash.


Best,


Pablo

1 Comment

Answer

Hi Prog,


If the suggested approach doesn't help, you should consider to use another tool like Scrapy spider with Splash.


Best,


Pablo

Login to post a comment