Whenever I run a job I get a specific job I get the below error
Not sure whats wrong it works fine on local
scrapy version Scrapy 1.6.0
File "/usr/local/lib/python3.6/site-packages/sh_scrapy/stats.py", line 2, in <module> from scrapy.statscol import StatsCollector ModuleNotFoundError: No module named 'scrapy.statscol
same issue here.
I solved my issue.
Currently, Scrapinghub only offers scrapy<=1.5. (Check this repos. )
ModuleNotFoundError occurs because in my requirement.txt, I installed my own module and it requires scrapy 1.6 and it automatically installed scrapy1.6 in the container.