Questions tagged [polipo]

Polipo is a lightweight proxy server capable of forwarding and caching.

Available under the MIT open-source licence, Polipo is aimed at individual and small group use though it can scale up to handle larger groups.

20 questions
7
votes
3 answers

missing polipo/config file in /usr/local/etc/

I use brew to install polipo through Mac OS terminal. It seems successfully install, but I can not find the config file and edit it.Can anyone help me figure out the reason?
pipi
  • 705
  • 1
  • 8
  • 16
6
votes
1 answer

Scrapy gets NoneType Error when using Privoxy Proxy for Tor

I am using Ubuntu 14.04 LTS. I tried Polipo, but it kept refusing Firefox's connections even if I added myself as allowedClient and hours of researching with no solution. So instead, I installed Privoxy and I verified it work with Firefox by going…
Arrow
  • 691
  • 2
  • 7
  • 15
4
votes
0 answers

Squid proxy server refuse connection for twitter

I have installed Squid proxy on my Ubuntu 16 vps. This is my squid.conf: auth_param basic program /usr/lib/squid3/basic_ncsa_auth /etc/squid/passwords auth_param basic realm proxy acl authenticated proxy_auth REQUIRED http_access allow…
Shahin Shemshian
  • 356
  • 1
  • 11
4
votes
1 answer

Scrapy-Splash with Tor

I have succeed to run Scrapy with Tor using this link: http://pkmishra.github.io/blog/2013/03/18/how-to-run-scrapy-with-TOR-and-multiple-browser-agents-part-1-mac/ But i couldn't run Splash with Tor. In Scrapy-settings.py I directed to polipo for…
2
votes
1 answer

How can I set a country limit in my proxy?

I do webscrapring with Scrapy, using Polipo as proxy, and Tor as network. I know my proxy makes rotating IP, but the IP location is most of the time out of my country. On the websites I scrape, it could have some blocking considering the location of…
AvyWam
  • 890
  • 8
  • 28
2
votes
1 answer

Configure proxy on mac with polipo

I am trying to configure proxy on my mac via polipo. I've installed polipo 1.1.1, but stuck to configure it. The point is that I can not find where the config file is to add proxy host and proxy port. Tried to search for the file via Finder, no…
2
votes
1 answer

Start tor and polipo when I launch my container

I wrote my first Dockerfile in order to test Docker with tor and polipo. My Dockerfile looks like: # Pull base image. FROM ubuntu:latest # Upgrade system RUN apt-get update && apt-get dist-upgrade -y --no-install-recommends && apt-get autoremove -y…
pi-2r
  • 1,259
  • 4
  • 27
  • 52
2
votes
0 answers

scrapy has response status 400 , but browser response is ok?

I have this strange situation, I have a link that works on all borwsers that I currently have (chrome,IE,firefox), I tried to crawl the page using scrapy in python. however I get response.status == 400, I am using tor + polipo to crawl anonymously…
nafas
  • 5,283
  • 3
  • 29
  • 57
2
votes
4 answers

Scrapyd with Polipo and Tor

UPDATE: I am now running this command: scrapyd-deploy And getting this error: 504 Connect to localhost:8123 failed: General SOCKS server failure I am trying to deploy my scrapy spider through scrapyd-deploy, the following is the…
Moataz Elmasry
  • 542
  • 1
  • 5
  • 18
1
vote
0 answers

Scrapy with Tor, Polipo in (Ubuntu) : how to renew IP

I have added the following code to /etc/polipo/config file: # This file only needs to list configuration variables that deviate # from the default values. See /usr/share/doc/polipo/examples/config.sample # and "polipo -v" for variables you can…
Debbie
  • 911
  • 3
  • 20
  • 45
1
vote
1 answer

use polipo to convert shadowsocks into an HTTP proxy

My ssserver is started by docker image oddrationale/docker-shadowsocks: docker run -d -p 1984:1984 oddrationale/docker-shadowsocks -s 0.0.0.0 -p 1984 -k paaassswwword -m aes-256-cfb Then I use sslocal command to get local proxy. sslocal -c…
lutaoact
  • 4,149
  • 6
  • 29
  • 41
1
vote
1 answer

Node.js + Polipo https request error

I'm doing a simple example using polipo with tor and it's working fine on my firefox browser. I've set polipo as the proxy and the browser works just fine. Then I tried doing a simple request in node.js based on a simple example, and it didn't…
1
vote
1 answer

curl an .onion url over an http proxy does not return expected source

The problem I'm testing an HTTP proxy that is wrapping a SOCKS proxy (TOR). It works ok for normal URLs but I'm getting strange results with some .onion addresses. In this example, I'm pointing at "the hidden wiki". The output looks like garbage: $…
matt burns
  • 24,742
  • 13
  • 105
  • 107
0
votes
0 answers

Polipo: multiple socksParentProxy and listens on multiple proxyPort?

I need to assign socksParentProxy to proxyPort for the each. For example, currently I have the following lines in the config: proxyPort = 18119 socksParentProxy = "localhost:18118" This does proxy "localhost:18118" to "localhost:18119". So the…
0
votes
1 answer

communication between polipo and tor kubernetes deployment

Where can I add socksParentProxy in Kubernetes deployment file to communicate polipo with tor. I already created tor service tor:9150 and tor deployment. Here is a my YAML file: apiVersion: apps/v1beta1 kind: Deployment metadata: name:…
1
2