Start a new topic
Answered

Dependency issue "requirement.txt" with "package_data" in setup.py

I want to deploy a non-code file located at "myproject/resources/FILE.txt" folder. It works perfectly setting up the "setup.py" file, considering following link instructions: 
"https://support.scrapinghub.com/support/solutions/articles/22000200416-deploying-non-code-files".


The problem appears when I also want to deploy Python dependencies following this link: https://support.scrapinghub.com/support/solutions/articles/22000200400-deploying-python-dependencies-for-your-projects-in-scrapy-cloud


When new Python dependencies are deployed, "myproject/resources/FILE.txt" is not detected, whereas the contrary is true when Python dependencies are not included. How is it possible? Should I update the "requirements" or "setup" file?


Please, let me know!


Best Answer

Finally, I included the "FILE.txt" information inside the spider source file as a dictionary. That's how I fixed it!


Answer

Finally, I included the "FILE.txt" information inside the spider source file as a dictionary. That's how I fixed it!

I can see you deployed successfully so I assume you figured this out.

Please post the contents of your setup.py, your scrapinghub.yml and requirements.txt files

Login to post a comment