Discussions

Community forums

What's new 4

Crawlera now supports HTTPS proxy endpoint

Posted by pablo, 3 months ago
Last Reply by pablo 3 months ago
Introducing free trials, new plans and overages

Posted by pablo, 12 months ago
Last Reply by dam dam 3 months ago
Introducing the Crawlera Weekly Digest

Posted by pablo, 8 months ago
Last Reply by pablo 8 months ago
New Crawlera Usage Stats Dashboard

Posted by pablo, 11 months ago
Last Reply by Mobius04 11 months ago

Ideas 11

Request Count

Posted by vmehend, 1 day ago
Last Reply by vmehend 1 day ago
Cancel Billing Account

Posted by cwohleber, 3 months ago
Last Reply by cwohleber 3 months ago
Format date-times as in Scrapy Cloud

Posted by Robb Shecter, 8 months ago
Last Reply by Robb Shecter 8 months ago
### Crawl Scrap Error

Posted by prem1202, 8 months ago
Last Reply by prem1202 8 months ago
Is anyone from Scrapinghub going to speak at PyTexas this May?

Posted by krwin, 11 months ago
Last Reply by krwin 11 months ago

Forgot My Email

Posted by Gerry Cruz, 8 minutes ago
Last Reply by Gerry Cruz 8 minutes ago
got SSL: WRONG_VERSION_NUMBER

Posted by David Chen, about 11 hours ago
Last Reply by David Chen about 11 hours ago
Crawlera not working with python requests.

Posted by Rylie Galicia, 1 day ago
Last Reply by Rylie Galicia 1 day ago
Python Requests Integration not working.

Posted by Rylie Galicia, 1 day ago
Last Reply by Rylie Galicia 1 day ago
requests count

Posted by vmehend, 1 day ago
Last Reply by vmehend 1 day ago

What's new 0

Ideas 16

Add ability to offset Periodic jobs.

Posted by feelixe, 4 months ago
Last Reply by feelixe 4 months ago
Timezone display preference per user

Posted by Robb Shecter, 8 months ago
Last Reply by Robb Shecter 8 months ago
Ideas for Scrapinghub improve your service

Posted by Marcos Machado, about 2 years ago
Last Reply by Tim 11 months ago
Can I access "Spider Settings" programmatically from the spider?

Posted by Alex Fedotov, over 1 year ago
Last Reply by Alex Fedotov over 1 year ago
Deploy general python project on Scrapy Cloud

Posted by Iris Yip, over 1 year ago
Last Reply by Iris Yip over 1 year ago

Declare pure environment variables or custom settings

Posted by rafael_vaquero, about 17 hours ago
Last Reply by rafael_vaquero about 17 hours ago
Web hook when sppider/job completed

Posted by priceedge, over 3 years ago
Last Reply by kevin.mcisaac 1 day ago
Manual github deploy doesnt show any branch

Posted by gittycodes, 4 days ago
Last Reply by gittycodes 4 days ago
ImportError: No module named html

Posted by cireyennek, 7 days ago
Last Reply by cireyennek 7 days ago
Scrapy-rotating-proxies

Posted by Stella Carneiro, 25 days ago
Last Reply by nestor 19 days ago

What's new 0

Ideas 3

splash instance not working!

Posted by rnrnstar2, 3 months ago
Last Reply by rnrnstar2 3 months ago
Need help with Splash

Posted by P0P1P2P3, 7 months ago
Last Reply by P0P1P2P3 7 months ago
why willwe have different results with splash and chrome accessing same website?

Posted by habout632, over 3 years ago
Last Reply by habout632 over 3 years ago

Ignoring response <410 - HTTP status code is not handled or not allowed

Posted by papamaci90, about 1 month ago
Last Reply by papamaci90 about 1 month ago
SSLError after host azure changed tls certificate root

Posted by kevin.marti, 2 months ago
Last Reply by kevin.marti 2 months ago
scrapy-splash crawler starts fast but slows down (not throttled by website)

Posted by Stephen Madison, over 1 year ago
Last Reply by lucaguarro 3 months ago
Need to increase the splash timeout

Posted by geeone, 4 months ago
Last Reply by geeone 4 months ago
scrapy Set custom request header

Posted by zwwayne, 5 months ago
Last Reply by nestor 5 months ago

Ideas 3

Is it possible to just give the html content (not the url) to AutoExtract?

Posted by Daxley, 16 days ago
Last Reply by afond45 6 days ago
Webhook for AutoExtract

Posted by Jorge Garcia, 8 months ago
Last Reply by Jorge Garcia 8 months ago
Get auth token from javascript response script

Posted by Luca Pierpaoli, over 1 year ago
Last Reply by Luca Pierpaoli over 1 year ago

Doing AutoExtract with PHP Curl

Posted by techytimo, about 1 year ago
Last Reply by promoautotest 3 months ago
Unclear how AutoExtract pricing works

Posted by beafdefx, 4 months ago
Last Reply by nestor 4 months ago
Request for refund

Posted by André Osti, 8 months ago
Last Reply by peixoto 8 months ago
Autoextract for Organisation data type

Posted by skoddowl, 10 months ago
Last Reply by skoddowl 10 months ago
Filemaker JSON Malformed

Posted by benjaminperon, 10 months ago
Last Reply by benjaminperon 10 months ago

What's new 0

Ideas 0

Unclean error

Posted by Dan Yates, 7 months ago
Last Reply by Dan Yates 7 months ago
Dynamic IP of spiders without crawlera

Posted by weinscoltd, 10 months ago
Last Reply by weinscoltd 10 months ago
Scrapy items from multiple URLs to a dataframe

Posted by Mehroof KA, about 1 year ago
Last Reply by Mehroof KA about 1 year ago
Always timeout when crawling Amazon.com product

Posted by zhangsj, about 1 year ago
Last Reply by zhangsj about 1 year ago
searching for webinars from specific providers

Posted by ggendron, about 1 year ago
Last Reply by nestor about 1 year ago