0
Answered
Kalo 2 months ago in Scrapy Cloud • updated by Pablo Vaz (Support Engineer) 2 months ago 1

Is there a way to load just a small element from a page's DOM instead of loading the whole page? I'd like to scrape just a few divs out of the whole html page. The idea is to increase the speed and minimize transfer bandwidth.

Answer

Answer
Answered

Hi Kalo, this can be done with a headless browser like Splash.

For example you can turn off the images or execute custom JavaScript.

To know more about it, please check the documentation in: https://splash.readthedocs.io/en/stable/

Kind regards,

Pablo Vaz

Answer
Answered

Hi Kalo, this can be done with a headless browser like Splash.

For example you can turn off the images or execute custom JavaScript.

To know more about it, please check the documentation in: https://splash.readthedocs.io/en/stable/

Kind regards,

Pablo Vaz