Start a new topic

Portia spider with custom feed exports

I'm trying to customize a Portia project to send the scraped data to another server by calling a REST API.

Basically, I want to create spiders following these steps:

1- Create the spider with Portia.

2- Publish the spider to Scrapy Cloud

3- When a scheduled job is completed, send the results in JSON format to the API.

How can I add a custom feed export to the Portia project? Does Portia overwrite all files when publishing changes?

Is it creating a custom feed export the right way to do it, or should I use a pipeline instead?


Login to post a comment