0
Answered
Jorge 3 weeks ago in Portia • updated by Pablo Vaz (Support Engineer) 2 weeks ago 1

it's posible apply filter to scraped data (i know it is posible) but i would like to download .JSON code with the filter criteria, and dodge rest of data, it is posible?


thanks in advance

Answer

Answer
Answered

Hola Jorge!


I think you can play a bit sharing data with spiders as shown in this article:

https://helpdesk.scrapinghub.com/support/solutions/articles/22000200420-sharing-data-between-spiders

but not sure if this is efficient for your purposes.


I would prefer to filter locally, but of course that depends on the project.


Best,


Pablo

GOOD, I'M SATISFIED

thanks you very much for your time

Satisfaction mark by Jorge 7 days ago
Answer
Answered

Hola Jorge!


I think you can play a bit sharing data with spiders as shown in this article:

https://helpdesk.scrapinghub.com/support/solutions/articles/22000200420-sharing-data-between-spiders

but not sure if this is efficient for your purposes.


I would prefer to filter locally, but of course that depends on the project.


Best,


Pablo