0

Update: see the comments for my solution.

My python code uses urllib2 to access a FTP server through a proxy with user and password. I use both a urllib2.ProxyHandler and a urllib2.ProxyBasicAuthHandler to implement this by following urllib2 examples:

1 import urllib2
2 proxy_host = 'host.proxy.org:3128'  # only host name, no scheme (http/ftp)
3 proxy_handler = urllib2.ProxyHandler({'ftp': proxy_host}) 
4 proxy_auth_handler = urllib2.ProxyBasicAuthHandler()
5 proxy_auth_handler.add_password(None, proxy_host, proxy_user, proxy_passwd)
6 opener_thru_proxy = urllib2.build_opener(proxy_handler, proxy_auth_handler)
7 conn = opener_thru_proxy.open('ftp://ftp.ftpserver.org/targetfile.txt')
8 print conn.read()

The code stops at line 7.

error messages are:

    conn = urllib2.urlopen(remote_fn)           
  File "/usr/lib/python2.6/urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "/usr/lib/python2.6/urllib2.py", line 391, in open
    response = self._open(req, data)
  File "/usr/lib/python2.6/urllib2.py", line 409, in _open
    '_open', req)
  File "/usr/lib/python2.6/urllib2.py", line 369, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.6/urllib2.py", line 1344, in ftp_open
    fw = self.connect_ftp(user, passwd, host, port, dirs, req.timeout)
  File "/usr/lib/python2.6/urllib2.py", line 1365, in connect_ftp
    fw = ftpwrapper(user, passwd, host, port, dirs, timeout)
  File "/usr/lib/python2.6/urllib.py", line 856, in __init__
    self.init()
  File "/usr/lib/python2.6/urllib.py", line 862, in init
    self.ftp.connect(self.host, self.port, self.timeout)
  File "/usr/lib/python2.6/ftplib.py", line 134, in connect
    self.welcome = self.getresp()
  File "/usr/lib/python2.6/ftplib.py", line 209, in getresp
    resp = self.getmultiline()
  File "/usr/lib/python2.6/ftplib.py", line 195, in getmultiline
    line = self.getline()
  File "/usr/lib/python2.6/ftplib.py", line 185, in getline
    if not line: raise EOFError
urllib2.URLError: <urlopen error ftp error: >

I have tested the proxy server by defining env variable ftp_proxy and access ftp file using 

wget --proxy-user=proxy_user --proxy-password=proxy_passwd ftp://ftp.ftpserver.org/targetfile.txt

and it successfully downloaded file from the ftp server.

How can I improve my code to access the ftp site using proxy with authentication?

HongboZhu
  • 4,442
  • 3
  • 27
  • 33
  • 1
    what happens if you set `http_proxy` or `ftp_proxy` environment variables to `http://user:passwd@host.proxy.org:3128` and use `urllib.urlretrieve()`? – jfs Sep 21 '13 at 22:18
  • Hi, Sebastian, I have just solved the problem myself. The environment variables were only set to test the proxy (together with wget). In principle, I would avoid using these env variables. Indeed, in the end, it turned out if I define proxy as: http://user:passwd@host.proxy.org:3128 and use only urllib2.ProxyHandler, it already works. urllib2.ProxyBasicAuthHandler just does not work. I don't understand why. This post also uses the same way to describe proxy (http://stackoverflow.com/questions/34079/how-to-specify-an-authenticated-proxy-for-a-python-http-connection). – HongboZhu Sep 21 '13 at 23:22

0 Answers0