I'm not a developer and need some help getting the portia/scrapy to load the mobile version of a website. I've gone into settings and added the following setting:
USER_AGENT = "Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1"
Portia is still loading the desktop version.
Any ideas of how I can set the user agent so the scraper can grab the data on the mobile site?
It would be great if you can share how you are setting the User Agent and also for which project and spider you are trying this setting.