Crawlera Examples

Examples of using Crawlera with different languages and technologies

Using Crawlera with Scrapy
The recommended way to use Crawlera with Scrapy is by using the Crawlera middleware which can be installed with: pip install scrapy-crawlera You can enabl...
Thu, 21 Nov, 2019 at 11:38 AM
Using Crawlera with Splash & Python requests library
You can use Splash with Crawlera to render JavaScript and proxy all requests issued from Splash. This may be necessary if your uses Splash heavily and targe...
Thu, 7 Sep, 2017 at 8:32 PM
Using Crawlera with Python Requests
Here is a code snippet that illustrates how to use Crawlera with Python Requests library: import requests url = "" pr...
Mon, 1 Jun, 2020 at 5:35 PM
Using Crawlera with PHP
cURL Making use of PHP binding for libcurl library: <?php $ch = curl_init(); $url = ''; $proxy = &...
Tue, 19 May, 2020 at 6:55 PM
Using Crawlera with Ruby
Making use of curb, a Ruby binding for libcurl: require 'curb' url = "" proxy = "
Fri, 26 Apr, 2019 at 2:16 PM
Using Crawlera with Node.js
Making use of postman-request, an HTTP client: var request = require('postman-request'); var fs = require('fs'); var proxyRequest ...
Fri, 19 Jun, 2020 at 3:54 PM
Using Crawlera with Java
NOTE Because of HTTPCLIENT-1649 you should use version 4.5 of HttpComponents Client or later. Extending an example published at The Apache HttpCompo...
Thu, 18 Jun, 2020 at 4:15 PM
Using Crawlera with Java and Jsoup
import org.jsoup.Jsoup; import org.jsoup.nodes.Document; import java.nio.file.Files; import java.nio.file.Paths; import; import java.uti...
Mon, 15 Apr, 2019 at 9:58 PM
Using Crawlera with C#
using System; using System.IO; using System.Net; namespace ProxyRequest { class MainClass { public static void Main(string[] args) ...
Tue, 26 Mar, 2019 at 9:55 PM
Using Crawlera with R
This is an example of using Crawlera with R. library(httr) r <- GET("",use_proxy(url = ""...
Thu, 28 Nov, 2019 at 12:07 PM